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Description I 
This invention relates to methods of coding an image. 

5 Image Coding 

The demand for electronic services related to pictorial images or other twc-dimen$ional data has grown so rapidly 
that even the accelerating advance of electronic transmission and storage technologies will not be able to keep pace, 
unless the electronic data derived from the images can be compressed in a way that doe* not impair perception of the 

io reconstructed image Or Other two-dimensional data. 

Different compression methods have evoh/ed in the art as understanding of pictorial data has increased and the- 
oretical advances have been made. Differential Pulse Code Modulation (DPCM) and bit-plane coding were among the 
early methods used, and they achieved compression factors of up to 4-6 by trading image quality tor lower bQ rate. 
Pictures with higher quality than obtainable with DPCM, coded with only one bit per pixel, can now be obtained with a 

is number of methods, such as the Adaptive Discrete Cosine Transform (ADCT) described by W. H. Chen and C. H. 
Smith, in Adaptive Coding of Monochrome and Cohr Images, Vol. COM-25, IEEE Trans. Comm., 12SS-92(Ncv, 1987). 
In an ADCT coding system, the image is decomposed into blocks, generally eight by eight, and for each of the blocks 
a OCT (Discrate Cosine Transform) is carried out. The compression is obtained by quantization of the DCT coefficients 
with variable thresholds, partially optimized for the human visual acumen, f oflowed by variable word length encoding. 

20 Sub-band coding of Images has been introduced to picture coding. One arrangement was proposed by J. W. Woods 
andS. D. O'Neil, in Sub-Band Coding of Images, Vol 34 No. 5, IEE5 ASSP, 1278-66 (Oct. 1966). The arrangement 
proposed by Woods et ai includes afilter bank that divides the image signal into bands ol different frequency contents. 
The signal of each filter output is compressed via DPCM. The compressed signals are then transmitted to a receiver ' 
where the process is reversed. Specifically, each signal is DPCM decoded and then up-sampled, filtered, and combined 

SS with the other filtered signafs to recover the original image. 

H. Gharavi and A. Tabatabai in Sub-Band Coding of Images Using Two-DimensfonaJ Quadrature Mirror Filtering, 
Vol. 707, Proc. SPlE, 51 -61 (Sept 1 886) use long complex quadrature mirror filters to obtain a number of frequency 
band signals. The "low-tow" band is DPCM coded using a two-dimensional DPCM codec. A dead-zone quantizer is 
used for the other bands, followed by PCM coding. 

so other sub-band coding schemes such as that proposed by R H. Westerink, J. W. Woods and D. E. Boekee in 
Proa of Seventh Benelux Information Theory Symposium 143-50 (1966), apply vector-quantization techniques to code 
the filter bank outputs. 

In the co-pending patent application of H. Bheda and A. Ugtenberft Serial No. 222,987, filed July 22, 1986 US- 
A-4 943 855. and assigned tothe assignee hereof, the data redundancies in the different sub-band signals are employed 

6 to achieve additional data compression. In fact, that technique provides an excellent front end" for image processing 
based on sub-band analysis techniques. 

There remains the problem of quantizing the analyzed information more effective fy; in terms of bits per pixel and 
perceived quality of a reconstructed image. We have determined that the existing versions of the Discrete Cosine 
Transform do not take full advantage of all facets of the known properties of human visual perception. 
40 some recent work has addressed this problem. Seethe article by King N. Ngan et al, Cosine Transform Coding 
Incorporating Human Visual System Model, SPlE Vol. 707, Visual Communications and Image Processing, 165-71 
(1 986), particularly addressing contrast sensitivity. The contrast sensitivity is applied to the quantization process in a 
very restricted fashion; and other relevant parameters are not applied, indeed, a kind of pre-emphasis is applied before 
quantization, apparently in preference to a more precise degree of control over the quantization process. 

45 

Image Halftoning 

Digital Halftoning, sometimes referred to as "spatial dithering", is the process of creating a binary approximation 
to asampled gray scale image. See for example. R. Ulichney, Digital Halftoning MIT Press, 1 987. Sampled gray scale 

£o values are typically quantized to have one of a discrete number of values, e.g., 256 or 1024 values. The basic idea in ^ 
digital halftoning is to replace these quantized picture elements (pixels) from a region of the gray-eeate image having 
an average value of x (where 0 = white and 1 = black) with a binary pattern of 1s and Os. In accordance with one 
halftoning technique, the fraction of resulting 1 s is approximately x. The binary pattern is then conveniently used with 
a display device such as a CRT display or a printerto produce the values for the pixels in the gray-scale halftone image. 

ss If the is and 0s are supplied to a printer where the Is are printed as black spots and the Os are left as white spaces, 
and if the spots and spaces are sufficiently close together, the eye averages the black spots and white spaces to 
perceive, approximately, gray level x. In so perceiving the image the eye exhibits a low-pass filtering characteristic. 
The number of gray-scale samples (pixels) is advantageously equal tothe number of bits in the binary pattern. 
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Recent years have witnessed increasing demand tor digital storage and transmission of gray-scale images. In 
part, this is due lo the increasing use of laser printers having a resolution of, e.g.. 300 spots (dots) per inch, to produce 
halftone approximations to gray-scale images such as photographs, art work, design renderings, magazine layouts, 
etc. The conventional approach to achieving high quality halftone images is to use a high resolution printer. However, 

5 It can be shown that the primer resolution required for transparent halftoning with prior art techniques is of the order 
of 1400 dots/inch. Such printers are often slow and expensive. 

Many prior art halftoning techniques assume that the black area of a printed binary pattern is proportional to the 
fraction of ones in the pattern. This means that the area occupied by each black dot is roughly the same as the area 
occupied by each white dot. Thus, the 'ideal" shape for the black spots produced by a printer (in response to 1's) would 

io be T x T squares, where T is the spacing between the centers of possible printer spots. However, most practical 
printers produce approximately circular spots. It is clear, therefore, that the radius of the dots must be at least J/J2 so 
that an all-ones binary pattern is capable of blackening a page entirety. This has the unfortunate consequence of making 
blackspots cover portions of adjacent spaces, causing the perceived gray level to bedarkertnan the fraction of ones. 
Moreover, most printers produce black spots that are larger than the minimal size (this is sometimes called 'ink spread* 

16 ing'}> whichf urther distorts In© perceived gray level. The most commonly used digital halftoning techniques (for printing) 
protect against such ink spreading by clustering blackspots so the percentage effect on perceived gray level is reduced. 
Unfortunately, such clustering constrains the spatial resolution (sharpness of edges) of the perceived images and 
increases the low-frequency artifacts. There is a tradeoff between the number of perceived gray levels and the visibility 
of low-frequency artifacts. 

2o Other distortions that can occur in commonly used laser printer such as the Hewlett-Packard line of laser printers, 
include the peculiar characteristic that a white line surrounded by several black lines appears brighter than when sur- 
rounded by two single lines. These cause further distortions to the perceived gray levels. 

Block replacement is one commonly used halftoning technique used to improve perceived and gray-scale Images. 
Using this technique, the image is subdivided into blocks (e.g. 6x6 pixels) and each block Fs "replaced* by one of a 

23 predetermined set of binary patterns (having the same dimensions as the image blocks). Binary patterns corresponding 
to the entire image are then supplied to a printer or other display device. TVpicafry, the binary patterns in the set have 
differing numbers of ones, and the pattern whose fraction of ones bast matches the gray level of the image block is 
selected. This block replacement technique is also referred to as pu tee-surface-area modulations. See the Ufichney 
reference, supra, at pg. 77. 

so in another halftoning technique known as screening, the gray scale array is compared, pixel by pixel, to an array 
of thresholds. A black dot is placed wherever the image gray level Is greater than the corresponding threshold. In the 
so called random dither variation of this technique, the thresholds are randomly generated, in another variation, ordered 
dither, the thresholds are periodic. More specifically, the threshold array is generated by periodically replicating a matrix 
(e.g., 6 x 6) of threshold values. 

as a technique known as error diffusion is used in non-printer halftone display contexts to provide halftoning when 
inkspreading and other distortions common to printers are not present See, for example,, R. W. RoydandL. Steinberg, 
■An Adaptive Algorithm for Spatial Grey Scale.* Proc. SID . Vof. 17/2, pp. 75-77, 1976. 

Like most of the known halftoning schemes, error diffusion makes implicit use of the eye model. It shapes the 
noise, i.e., the difference between the gray-scale image and the halftone image, so that it is not visible by the eye. The 

to error diffusion technique produces noise with most of the noise energy concentrated in the high frequencies, i.e., so* 
called blue noise. Thus, it minimizes the low^requency artifacts. However, since error diffusion does not make explicit 
use of the eye model, rt is not easy to adjust when the eye filter changes, for example with printer resolution, or viewer 
distance. Error diffusion accomplishes good resolution by spreading the dots. It Is thus very sensitive to Ink-spreading, 
in contrast to the clustered dot schemes like ■classical" screening. In the presence of ink spreading, error diffusion 

45 often produces very dark images, therefore limiting its application to cases with no ink-spreading. 

Model-based halftoning approaches have been described generally in the context of printed images. For example, 
Anastassiou in the paper, "Error Diffusion coding for A/O Conversion.'. IEEE Trans. Cir. Svs.. \tol. CAS-36. No. 9. pp. 
1175-1186, September 1989 proposes a frequency weighted squared error criterion" which minimizes the squared 
error between the eye-filtered binary and the eye-filtered original gray-scale image. He considers the problem intrao 
table and suggests an approximate approach based on neural networks. Moreover, the disclosed techniques assume 
perfect printing, Le., printing without distortion. Allebach, in the paper "VUuaJ Model-Based Algorithms for Halftoning 
Images/ Proc. SPlE. Vbl. 310, Image Quality, pp. 151-158, 1981. proposes avisual modelto obtain a distortion measure 
that can be minimized, but provides no complete approach to achieve halftoning. 

Roetling and Holladay, in the paper "Tone Reproduction and Screen Design for Pictorial Electrographic Printing," 

6 Journal of AppL Phot. Eng. . Vol, 15, No. 4, pp. 179-182, 1979, propose an ink-spreading printer model, of the same 
general type used in the present invention, but uses it only to modify ordered dither so that it results In a uniform gray 
scafe. Since ordered dither produces a fixed number of apparent gray levels, this technique cannot exploit inkspreading 
to generate more gray levels. 
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According to this invention there is provided a method as claimed in claim 1 . 

A sub-band analysis method for electronic image processing includes determining the amount of quantizing noise 
which would be just imperceptible in respect to one or more of the parameters of frequency contrast and texture, and 
aoapting the quantization of each pixel in response to such one or more parameters so that the amount of quantizing 
$ noise is relatively near, but below, the limit of perceptibility. By thus allowing the amount of quantizing noise to rise 
when it is imperceptible, we are ao(e to achieve unprecedented data compression of a transmitted or stored image 
without perceptible degradation in the reconstruction thereof. 

An illustrative method of the present invention concerns transmitting two-dimensional information, such as an 
image, for printing. 

10 

Brief Description of the Drawings 

FIG. 1 is a block-diagrammatfc showing of a generic organization of an image coding technique of the type to 
which our invention is directed. 
is FIG. 2 depicts a block diagram of encoder 1 2 of FIG. 1 

FIG. 3 shows curves of the characteristics of filters usable for each stage of filtering in the analysis fitter bank of 
FIG. 2. 

FIG. 4 is a block diagrammatic illustration of the organization of the analysis filter bank of FIG. 2. 

RG5 depicts the signal flow in the perceptual modefing. 
&> FIG. 6 is a block diao/ammatic showing of the encoder25 of FIG. 2. 

FIG. 7 Is a block diagrammatic showing of one organization of the decoder 14 of FIG. 1. 

F1G. 8 shows a table useful in explaining the invention. 

FIG. 9 shows a curve useful in explaining the invention. 

FIG. 10 shows a block diagram of the reconslruction filter bank of FIG. 7. 
26 FIG. 11 shows a well-known sensitivity characteristic of the human eye. 

FIG. 12 shows a simple eye model based on prior art teachings. 

FIG. 1 3 shows an impulse response for a filter used in modeling human visual perception. 

FIG. 14 shows a frequency response for the fitter of FIG. 13. 

FIG. 15 shows a pattern of black spots in accordance with an Ideal printer model. 
so fjg. 16 illustrates an ink spreading phenomenon occurring in certain printers. 

FIG. 17 illustrates geometrically, the meaning of certain parameters used in defining typical printer models. 

FIG. 18 iBustrates the parameters shown in FIG. 7 for particular dot patterns. 

FIG. id iBustrates certain aspects of a one-dimensional ink-spreading printer model 

FIG. 20 is a block/flow diagram illustrating the prior art error diffusion halftoning technique. 
ss FIG. 21 is a block/flow diagram illustrating modifications to the error diffusion techniques illustrated in FIG. 20. 

FIG. 22 shows a blcckfflowdiagram of an embodiment based on one-dimensional least squares error minimization. 

FIG. 23 shows a bfockfi low diagram of an embodiment based on twcxiimensional least squares error minimization. 

FIG. 24 presents a further illustrative embodiment. 

FIG. 25 presents an illustrative halftoner for use with the embodiment presented in FIG. 24. 
40 FIG. 26 presents one period from an array of periodic thresholds used In 8X8 classical halftone screening. 

FIG. 27 presents artificial contours which result from the mapping of 256 gray-scale levels to 33 levels from classical 
halftone screening. 

FIG. 28 shows the elimination of undesirable contours present in FIG. 26 through the addition of micro-dither. 
FIG. 29 presents a sub-band image with a noise squat* and an identical image wrthoutlhe noise square* 
45 FIG. 30 presents results of a perceptual analysis for sub-band base sensitivities. 
RG. 31 presents an illustrative factor for brightness adjustment. 

Detailed Description 

SO . Perceptually-Adapted Image Coding 

FIG. 1 illustrates the basic communication system for practicing our invention. It includes a transmitter 11 including 
an encoder 12 connected, via a transmission channel 15, toa receiver 13 including a decoder 14. Transmission channel 
15 should be considered in its broadest sense to include a storage medium, such as a compact disk read-only memory 
55 (CD ROM) or digital tape medium. That is. rather than sending encoded signals to a receiver in p reaJ time," one can 
store the signals in such a "channel" and reproduce them at a latter time upon request This concept encompasses, 
of course, situations that are not usually thought of as communicating, the channel or "medium" being a purchased 
recording and the transmitter and receiver serving recording and reproduction functions of Interest to a consumer, even 
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for use in his home. Another major application includes archiva? of major collections of photographs, as in geological 
surveying. The "channel - 15 is then the archive. 

FIG. 2 depicts a block diagram of encoder 12. ft deludes an analysis filter bank 22 to which the image signai is 
applied. The image signal can have any number of formats, and the standard raster format for two dimensional images 

s is an acceptable one. For digital filtering, the signal already has been pre-sampled (by means not shown), in addition, 
the signal mean value has been removed by processor 21 . it is quantized to S bits and presented to the Perceptual 
Model (28) and the multiplexer (30). In FIG. 2 r filter bank 22 has 16 outputs, from (0. 0) to (3, % but it is understood 
that this can be any number greater than 1 . These correspond to the 1 6 possible signals of an image that was tittered 
krtoa high band and a low band and two intermediate bands in both the horizontal dimension and the vertical dimension. 

10 The respective four bands of developed image data in the horizontal dimension, for example* are then passed through 
the corresponding Vertical filters". The reorganization of the data implied here is simply done when the data is in the 
sampled data format. For most scenic images, as contrasted with images comprising merely lines, the lowest band 
image (low pass filtered both horizontally and vertically) contains the bulk of the relevant visual information, while the 
other bands contain detail information. 

*s Utilizing the above, FIG. 2 includes a coder 24 that is responsive to the lowest band (0.0) image for both directions. 
The quantizer-encoder apparatus 25 in coder 24 responds to the human visual system adaptation signal on lead 26 
to render the Quantizing and encoding process responsive to the perceptual analysis occurring in perceptual model 
26. In coder 24, the quantizer-encoder 25 is followed by a Huffman encoder 27 to prepare the signal for multiplexer 
30. One of the Inputs to model 28 is derived from processor 21 In order to provide one datum for each pixel related to 

a> contrast and brightness. 

The other inputs to perceptual model 23 are exactly the inputs to coder 4 24 and the other 15 similar coders. 
The other coders responding to other frequency bands, e.g.. coder 29 and coder 31 , are organized similarly to the 
organization of coder 24. 

In our system, as contrasted To thai of the above-cited co- pending patent application of Bheda et a/. ? the com- 

2$ pression of the data achieved, lor example, in coder 24, is a direct consequence of the principles of our invention, 
which win now be descrbecL 

One possible implementation of the filter bank (22) would utilize an equal bandwidth filterbank using separable 
Generalized Quadrature Mirror Filters (GQMF). as described in the article by R V Cox. The Design of Uniformly and 
Nonuniform!/ Spaced P&eudo Quadrature Mirror Filters, Vol. ASSP-34, No. 5, IEEE Trans. ASSP, 1090-96 (Oct 1 986). 

so a separable two dimensional filter consists of two one dimensional filters applied in orthogonal directions. In our case, 
a GQMF filter is applied first to the rows of an image, providing horizontal filtering as illustrated by filters 40-45 of FIG. 
4, then the same filter is applied to the columns of the horizontally filtered images to provide the vertical filtering. Typical 
filter characteristics are shown in curves 35-38 of RG. 3. 

The output of filters 40-43 can be down-sampled (sometimes called 'subsamplecT); and, to that end, down-san> 
pling switches 45-48 are to be responsive to filters 40-43, respectively. Down-sampling can be accomplished, for ex- 
ample, by ignoring three out of every four samples (while, on the other hand, up-sampling would be accomplished by 
repeating a given sample). The outputs of down-sampling switches 45-40 are applied to transpose memories 50-53, 
respectively, that transpose the pixel signals of the two-dimensional image in the manner of transposing matrices. 
Transpose memories 50-53 are conventional memories in which signals are stored in one way (following rows) but 

*o accessed in a different way (following columns). Such memory arrangements are well known in the art. For the sake 
of completeness, however the following simple implementation is suggested. To obtain transposition, one may use an 
address counter and a memory responsive thereto, with a logic circuit interposed therebetween. The logic circuit allows 
for interchange of a number of least significant bits of the counter with higher significant bits of the counter A normal 
sequence is thus obtained without the interchange of bits; and the transposed sequence is obtained by interchanging 

45 the bits. 

The output of transpose memory 50 is applied to filters 55-58, and similarly the outputs of transpose memories 
51 -53 are respectively applied to sets of filters 60-63* 65-68, (not shown) and 70-73. These sets of filters, for example, 
55-53, are exactly like filters 40-43, in the same order and, in fact, may be implemented on a time-shared basis by the 
same set of digital filters. The outputs of filters 55-73 are applied to down-sampling switches 75-93, respectively (each 
so numbered 20 digits higher than its corresponding filter), which produces the outputs of analysis filter bank 22. The 
GQMF fitters we used split both the horizontal and vertical dimensions into four equal width bands. This number of 
bands provides a convenient tradeoff between spatial and frequency localization, as fewer bands would provide too 
coarse frequency analysis, white more bands would blur spatial localization. 

The lowest frequency in both dimensions is in sub*band (0.0). while the highest frequencies in both dimensions 
S5 areinband (3,3). The GQMF filter that was used in our system hasafirstsidelobe suppression of >48dB p which ensures 
perfect reconstruction of an 8 bitfpixel imago. 

The perceptual masking model (28) provides an estimate of the amount of coding distortion that may be added to 
each pbcel in each sub-band signal so that there will be no discernible difference between the original image and the 
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coded version. This model utilizes several well known properties of the human visual system (HVS) in unique ways. 
lh& properties we use are: frequency response; contrast sensitivity; and texture masking. TTiis model is not meant to 
be a complete description of the HVS, but it provides an approximation of the effects major HVS properties have on 
the perception of an image given a particular analysis/synthesis procedure. 

s Tfte frequency response component (102) provides the maximum amount of distortion that can be added to each 

of the sub-band signals given a mid-gray flat-field image as input. The HVS is most sensitive to noise is this type of 
stimulus. The other components of the model adjust this distortion estimate for deviations in the image's brightness 
from mid-gray (block 109). and for its deviations from flat-fieW (block 1 01 ), These estimates are then combined (block 
104), and presented as Input to each of the sub-band encoders (24). 

10 The base sensitivity estimates were derived from a set of psychophysical experiments. A uniform mid-gray image 
was presented to the analysis filter bank (22). For one of the resulting sub-band signals, say (0.0), white, uniform 
random noise was added. This distorted signal. aJong with the other 15 undistorted signals were presented to the 
reconstruction filter bank (i 50). This distorted image, and the original were viewed side by side in a darkened room at 
a viewing distance of 6 times image height. The variance of the added white noise was adjusted to find the maximum 

is value for which a human observer could perceive no difference between the original and distorted images. This process 
was then repeated for each sub-band signal in turji. Typical RMS noise sensitivity values for this experiment are pre- 
sented m Figures & These values were experimentally derived and are dependent on the particular filters used in the 
anaty sis filter bank, and the viewing distance, therefore some variation in these values should be expected. 

These values provide the allowable coding distortion for one particular stimulus, namely a mid-gray flat field. The 

20 brightness adjustment term Is used to generalize this model to flat-fieJd stimuli with varying brightness. The previous 
experiment was repeated tor sub-band (0,0), but the gray level of the flat field input was now varied from pure black 
to pure while. Again, the maximum amount of white noise that could be added to the stimulus was determined. The 
resulting deviations from the sensitivity values for mid-gray flat field are shown in Figure &. The correction factor is 
applied by computing the local image mean, looking up the value of the correction factor in Figure 9, and multiplying 

& the base sensitivity for the sub-band by that value. For the conditions of the base sensitivity experiment (gray level of 
127), it provides no adjustment, but for higher and lower gray levels. It allows for substantially more coding distortion. 
A full implementation of this correction term would repeat this series of experiments for each sub-band, resulting in 1 6 
correction curves. However, it was determined that the shape of this curve is essentially constant across relevant sub- 
bands, so an efficient implementation uses this one curve for every sub- band. 

so The final component of the perceptual metric provides an adjustment for the decreased noise visibility given non- 

flaj-field inputs, i.e texture. Flat-field stimuli have only DC frequency components, while textured input has both DC 
and AC components. The noise visibility for the DC component is accounted for by the base sensitivity and brightness 
adjustment terms, while the texture masking term (1 01 ) handles the AC terms. This texture masking term consists of 
a weighted sum of the AC portion of the energy in each sub-band. Since the HVS has a non-uniform transfer function, 

a* the energy in each sub-band is weighted by the relative visibility of the frequencies contained in each sub-band. 

In practice, a value for the perceptual metric is determined at every point in every sub-band. One possible imple- 
mentation could use table look-up indexed by sub-band number to determine the base sensitivities, and table look-up 
indexed by the sum of the overaJf image mean and the local value from each point in sub-band (0,0) to determine the 
Brightness Adjustment. The texture masking term could be computed by taking the variance over a 2x2 pixel block h 

40 sub-band (0,0) (This computes the AC energy hn the lowest frequency sub-band) weighted by the average HVS re- 
sponse in band (0,0). For each of the other sub-bands, added to this term would be the average energy over a 2x2 
pixel block weighted by the average HVS response for that sub-band. This composite term would then be raised to 
the power 0.065. This number was set to ensure that highly textured images would be transparently coded. Each of 
these terms are input to the combination block (1 04) where they are multiplied together to produce the final value for 

4s the perceptual metric. This procedure will provide a metric that wffl produce visually transparent coding. If seme per- 
ceptible distortion is allowable, this metric could be relaxed multiplying it by a constant > 1.0. 

The perceptual metric is then used to control a DPCM encoder (25) (Figure 2) for each sub-band. DPCM coding 
is well known in the prior art. The predictor block (108) uses a three point predictor utilizing the previous point, previous 
row, and back diagonal, is used. The optimal predictor coefficients are computed for each sub-band and quantized to 

so 5 bit aqcuracy. rf a portion of the sub-band is coded, these coefficients are sent as side information to the decoder. 

A uniform quantizer is used (iQ6). its step size is determined by the perceptual metric function (28 in FIG. 2). If 
the absolute value of the difference between the original and coded signals Is less than the value of the metric, the 
coded image will be visually indistinguishable from the original. One means of satisfying this condition is to set the 
quantizer step size to twice th e minimum value of the perceptuaf metric over a sub-band in quantizer stepsize calculator 
107. This step size is quantized to 1 6 bit accuracy and sent as side information to the decoder. The summation function 
1 06 operates on the sub-band image signal and the output of predictor 1 08 to provide the input to the uniform quantizer 
107. The output of the quantizer, hereafter called code words, denoted c(x,y,i,j) where x and y are the spatial location 
within a sub-band, and i and j are the sub-band number, are passed to the Huffman encoder (27). 
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Noiseless Compression 

First, inside of each sub-band, the codewords c(x,y,i,j), are partitioned into 4x4 partitions. For the purpose of dis- 
cussing the noiseless compression, we will assume that th© original image is 512x512 pixels, ergo each sub-band is 

s 128x128. There are 32x32 partitions, each containing 4x4 codewords, in the 128x128 sub-band image. The number 
512x512 is chosen for the purpose of illustration, other ekes of original anoVor sub-band image may be compressed 
via this compression algorithm. Since the noiseless compression works identically in each sub-band, the notation 
indicating eubJaand. ij will usually be omitted. The variables used in this section will be klO*k,\<92, which are the 
indices for the partitions. First, for each partition, the largest absolute value, LAV, contained in each partition is caJcu- 

™ fated, /.e\, LAV(kJ)=max(ac*(c(x,y/i,j))). 4k<fc<4(k+1), 4fey<4<l+1). where c(*) is the DPCM codewords lor the proper 
sub-band from the process above. 

After the LAV(*) are calculated, the number of non-zero LAV(k.l) are counted. If there are no non-zero LAVs„ the 
sub-band has no coded data to send, and a zero bit is sent, indicating that "this band is not coded". If there are non- 
zero LAVs, a V bit is sent If there are non-zero LAV'S, but fewer than roughly 1 50, the k,l addresses of each are sent. 

is at a cost of 5 bits per k or 1 , along with a 9 bit count indicating how many coded partitions there are. These kj pairs 
are used to indicate which blocks will have their c(*) encoded. If tfrere are a large number of non-zero partitions, a 
■Dimensionality Map* is calculated and sent for the entire sub-band 

Calculating the Dimensionality Code 

20 

Regardless of the number of non-zero partitions, a short Huffman code is calculated from the LAV distribution, 
based on a 4-way partition of the LAVs in the case of many non-zero partitions, or a three-way partition in the case of 
a few non-zero partitions. This code is used to generate a "Dimensionality Map' that can be used at the transmitter 
and efficiently transmitted to the receiver. For the 4-way case, the number of N z = number of 2ero LAVs, 
as number of 0<LAVs9,Ng d = number of 3<LAV£25. and N 1d = number of 25<LAV are calculated, and for the 3-way case, 
N z is omitted. This 2 to 4 element code is transmitted at a cost of 8-30 bits, depending on the data, to the receiver. 
Symbols with zero occurrences are not deluded In the codebook. 

Calculating the Dimensionality Map 

so 

A dimensionality map is then transmitted to the receiver, using the code calculated above, where one of the four 
symbols z, 4d, 2d, or 1d is sent for each partition in the case of many non-2ero partitions, or one of three 4d, 2d, or 
Id, is sent in the case of few non-zero partitions. The number 150 that is used to determine 'many" vs. 1 ew - is selected 
because it is the average crossover point between kj addressing cost and transmission of the entire map. 
55 This ■Dimensionality Map* is used to deteimine the way that the c< # ) are encoded, both at the transmitter and 
receiver. In the case of few non-zero partitions, the "Dimensionality Map" Is called the "Reduced Dimensionality Map', 
as the location of the non-zero partitions is explicitly transmitted, rather than determined implicitly from the position in 
the dimensionality map. 

Tranem fttlng the Codewords 

The codewords, cf), are transmitted last In the noiseless compression sequence. One of three encoding methods 
is used for each partition in which the LAV is non-zero, depending on the entry in the dimensionality map in for that 
partition. In cases where the IAV for the partftion is known to be zero, either by omission in the reduced dimensionafily 
45 map, or explicitly in the dimensionality map, the c(*)'s are not transmitted. 

Id Coding 

The 1 d coding is a one-dimensional Huffman coding of the 1 6 cf)'5 In the partition, and is used when the 1 d symbol 
so appears in the dimensional rty map. Each eft Is separately encoded using a selected pre-generated Huffman codebook. 
The codebook selection (one of sfc) for each entire sub-band for 1 d coding Is made on the baste of which of the $ i d 
codeboote provides the best compression. The information on codebook selection for 1 d, 2d, and 4d are all transmitted 
after the dimensionality map. but before any of the c(*) data is transmitted. 

55 2d Coding 

The 2d coding is done on the partitions that have a 2d symbol in the dimensionality map. For these partitions are 
encoded as 8 pairs of 2 cO's. using adjacent horizontal pairs to find an entry in one of six 2-dimenslonal Huffman 
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codebooks. Again the best 2-d codebook is selected on a sub-band by sub-band basis, and the codebook selection 
is passed to the receiver as above. 

4d Coding 

The 4d coding is done on the partitions that have a 4d symbol in the dimensionality map. For these partitions, the 
c(*)*s are encoded as 4 groups of 4 elements each. Each of the ac2 sub-squares of the partition is encoded as one 
codeword in a 4 dimensional Huffman codebook. The codebook selection is done as above. 

io Compression Results 

The compression results from the above methods have the following properties: 

• Totally vacant (in the perceptual sense) sub-bands are encoded using 1 bit, or a rate of bits/pixel (1 6384 = 
is 12S 2 ). 

• in sub-bands where only a few perceptually significant partitions exist, each is encoded with 1 0 bits for the location, 
approximately 2 bits for dimensionality, and a small number of bits for the cfys. This allows for efficient encoding 
of a small part of any given sub-band where that part is perceptually important 

to 

• In bands where more than about 1/B of the band is encoded, all partitions are encoded, but 

- All-zero partitions are encoded at a rate of bits/pixel, if all-zero partitions are common, 

ss - Parte of the sub-band that have a very few non-zero, or all small values, are encoded with a 4 dimension 
codebook that provides a minimum of £ brts/pbcelfor aH-zero sub-partitions, in addition, any residual correlation 
spread over the 2x2 squares is efficiently encoded 

. parts of the sub-band with moderate activity are encoded at a minimum rate of ^ bits/pixel, and the residual 
30 correlation also taken care of by the codebook. 

- Parts of the sub-band with very high activity are encoded with a coding method that has a minimum rate of 1 
bit/pixel, but that also allows tor maximum values as they may be required by the perceptual process, wflhout 
requiring the use Of logg (abs(2c mrt< )*2+1) bits for each element. 

<3S 

- The use of 6 codebooks for each dimensionality allows the coder to choose from a variety of probabilityJoorrelatlon 
combinations. While this result does not greatly increase the compression rate, on the average, ft does greatly 
increase the effectiveness of the compression algorithm on the most difficult items. 

40 * The use of a short (4 efement) internally generated Huffman code for the dimensionality map allows effective and 
efficient transmission of the dimensionality map. As an example, in many higher sub-bands the only symbols 
needed are z and 4d. Given the locally calculated and easily transmitted codebook. for that case only 1 bitmap 
element is used, making the ■side-informarion" cost only ^ bits/pixel. .LE 

4$ Codebook Generation 

This section describes the method we use to generate the codebook set for the Huffman compression of the c(*) 
's. There are three sets (4d, 2d, and id) of six codebooks that must be predetermined 

The Huffman codebooks are generated from the probability distribution of the data that they encode, so the task 
so is that of partitioning the data into 6 sets based on their statistics s uch that the Huffman codes are efficient We do the 
in several steps: 

1 . First, we partition the appropriate data ( 4d,2d or Td ) into s« sets, via the Modified K-Means algorithm and the 
total frequency content, or on an image by image basis, 
& 2. Using the distribution for each set. we generate a Huffman codebook. 

3. Using that set of codebooks, we encode the entire training set, at each sub-band selecting the best of the six 
codebooks for each dimensionality, and saving the number of occurrences in each codebook slot for the selected 
codebook. 
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A. Using the new set of distributions, generate a new Huffman codebook set. 

5. Repeat the process of the last two sentences until the exchange of sub bands between codebooks becomes 
infrequent 

s These steps are based on the following; 

♦ Each time a different codebook selection is made, a new and better encoding has been selected. II a codebook 
change is not made, the average rate remains the same. 

• Each time a new codebook is calculated, it fits the data that it is applied to better, and provides the same or better 
io compression because it is calculated to fit the current, rather than the last iteration's data. 

This codebook selection procedure is run on a training set of 107 images. 

Codebook Effectiveness 

is 

The codebooks selected and trained on our training set have been tested on a 36 element set of test images that 
are different than the training images. The performance of the compression algorithm, including the codebooks. on the 
test images is equivalent to the performance on the training set. 

We have imposed various mismatches deliberately, such as changing the quality offset (by ±5 or ±1 0 dB). while 

20 using the codebook for zero offset The compression results, while not as good as is possible for a properly generated 
codebook, are still close to that of the properly generated codebook for perceptual offsets within the +1 0 to -5 range. 

There are 6*7 4 elements in the 4d codebook set, 6*51 2 in the 2d set, and 6*769 elements in the 1 d set, for a toted 
codebook size of 34626 entries. This small codebook set suffices for the range of images from simple scenery with 
tow contrast all the way to complex text or texture images. 

25 Our preliminary tests of the invention demonstrate the interaction of the low-pass spectrum of images and the 
perceptual metric work together to reduce the amount of information that needs to be coded, including a significant 
reduction in the average percent of time in which .ul at least one 4x4 block of a sub-band must be coded, and in the 
percent of each sub-band that is coded given that at least one 4x4 block is coded. These can be interpreted by thinking 
of sub-band (0,0) as a reduced resolution version of the image and the rest of the sub-bands as 'detail* images at 

so increasingly finer levels. Therefore band (0,0) has the greatest amount of perceivable information about the image, 
while the higher frequency bands contain perceivable information only where there is a certain type of detail Smooth 
low detail areas require only one sub-band (although the value of the pe rceptual metric may be quite smafl at the point), 
while high detail areas, such as edges, require information from several sub-bands. 

In FIG. 7. there is shown the detailed implementation, according to our invention, of receiver 1 3 and decoder 14 

ss of FIG. 1. 

The arrangement of FIG. 7 simply reverses the encoding process. The receiver-decoder of FIG. 7 includes the 
de-muJtipfexer 110, the Huffman decoders 111 -126 for each of the individual 16 sub-bands, the inverse differential PCM 
processors (decoders) 1 31-146. the reconstruction filter bank 1 50, and the combiner circuit 1 51 . which could be shown 
as a part of reconstruction filter bank 150. 
40 Reconstruction fitter bank 150 is detailed in FIG. 10; and it will be seen that this figure provides the same type of 

apparatus, but operating to merge the sub-bands, as the apparatus of FIG. 4> with up-sampling replacing down-sam- 
pling. 

Of course, the mean value that was removed in apparatus 1 21 of FIG. 2 was also transmitted or recorded and 
must be re-inserted in combiner 151 of FIGS. 6 and 7. 
45 Specifically, each of the sub-band passes through its respective up-sampling switch 161-176, where values are 
repeatedfrom (4) times, through the respective of fitters 1 81 -1 96, through combiners 1 97-200, through transform mem- 
ories 201 -204, up-sampfing switches 205-20& and filters 211 -214 to combiner 1 51 . 

Finally, our tests demonstrate that the combination of multidimensional noiseless compression and the omission 
of coding of blocks that meet the perceptual metric provide a very powerful bit-rate reduction scheme. The linear 
SO codebook is used only for portions of the low frequency sub-bands, white^ the 2D and 40 codebooks. with their lower 
bit-rate, are used everywhere else. This scheme allows extremely fine quantization of the data where it is necessary, 
without the large bit-rate penalty where it is not The reproduction of the two dimensional information Is of surprisingly 
good quality; and the algorithms are capable of imperceptible degradation. 

It should be apparent that various modifications of the inventions are possible within the scope of the above- 
ss described principles of operation. For example, the adjustments for frequency and contrast sensitivfty could be sepa- 
rated more completely than they ar© in the base sensitivity and brightness adjustment processes of FIG. 5. 
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Model-Based Halftoning 

Models of Visual Perception 

5 To help understand the use of primer models; 

a brief introduction tosome aspects of human visual perception will be presented. As mentioned above, haJftoning 
works because the eye perceives a set of closely spaced black and white spots as a shade of gray Alternatively, it 
may be said that the eye acts as if it contained a spatial tow pass filter. 

Numerous researchers have estimated the spatial frequency sensitivity of the eye, often called the modulation 
>0 transfer function (MTF). Typical of such is the following estimate for predicting the subject quality of coded images. 



H(f) = 2.6(0.0192 + 0.114f)cxp 




where f Is In cycIesVdegree, See Mannos, J. L. and D. J. Sakrlson, "The Effects of a Visual Fidelity Crftereon on the 
so Encoding of Images/ lEEETrans. on Info. Th. . Vol. IT-20, na 4, pp, 525-536, July 1 974. This MTF band on the Mannos 
and Sakrfson teach ings is plotted in FIG. 11. As indicated by 6q. <1 ). the eye is most sensitive to frequencies around 
3 cycles/degree. Others have variously estimated the peak sensitivity to lis between 3 and 10 cycles/beg ree. The 
decrease in sensitivity at higher frequencies is generally ascribed to the optical characteristics of the eye (e.g. pupil 
size). FIG. 11 shows that the sensitivity of the eye has dropped 3 db from its peak at about 3 and 16 cycles/degree, 
a* 20 db at 35 cycles/degree and about 46 db at 60 cycles/degree. The decrease in sensitivity a! low frequencies accounts 
for the "Slusion of simultaneous contrast" (a region with a certain gray level appears darker when surrounded by a 
lighter gray level than when surrounded by a darker) and for the Mach band effect (when two regions with different 
gray levels meet at an edge, the eye perceives a light band on the light side of the edge and a dark band on the dark 
side of the edge). 

so The eye is more sensitive to horizontal or vertical sinusoidal patterns than to diagonal ones. Specifically, it is lest 
sensitive to 45 degree sinusoids, with the difference being about .6 db at 1 0 cycles/degree and about 3dbat 30 cycles/ 
degree. This is not considered to be large, but It is used to good effect in the most commonly used halftoning technique 
for printers as will be described more completely below. 

Many models have been proposed that attempt to capture the central features of human visual perception. For 

35 example, see Jain, A. K., Fundamentals of Digital Image Processing, Prentice Half, Englewood Cliffs, N, J. 1939, 
especially pp. 56-57; Comsweek, T. N., VisuaJ Perception. Academic Press, New York, N. Y, 1970; and Netravali, A, 
N., and B. G. Haskell, Digital Pictures: Representation and Compression, Plenum, New York, N. Y, 1989, especially 
pp. 292-297. The simplest visual perception models include just a filter, for example the fitter of Eq. (1 ). Another, and 
perhaps most commonly cited include a memoryless nonlinearity r as shown in FIG. 12. There, the input image, repre- 
sented by x, is shown being subjected to the memoryless nonlinearity 301 to produce a modified image, y, before being 
filtered by filter 302, e.g., that of Eq. (1). The output, z. of firter 302 is the perceived image. Such nonfinearities account 
tor Weber's law, which says that the smallest noticeable change in intensity is proportional to intensity (intensity = 1 - 
gray level). Most commonly it is represented as a logarithm or power law (e.g.. 1 - (1-x) 1 *). More complex models 
include, for example, a filter before the nonlinearity 301 or a bank of filters in place of 302. 

4s in many cases* practical considerations dictate a finite impulse response (FIR) filter for modeling eye character- 
istics, Indeed, for certain of the least-squares halftoning techniques described below it proves advantageous to use a 
one-dimensional discrete-space model of the form 

so , Zk= M <W--<W' t (2> 

where the x^s are samples of the image (from one line or one column), the art the model outputs (upon which 
cognition is based), and M(.) is a slid Eng-window function with 2m + 1 arguments (m is a non-negative integer). Such 
a model can easily incorporate a memoryless nonlinearity and an FIR filter. Typical models that can be used are typically 
56 of the form 
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z k = n(x k *h K ), (3) 

where n(.) is a memoryless nonlinearrty. h. m , ..„ h rt is the impulse response of an HRfilter and • denotes convolution. 
Also appropriate in some circumstances for the nonlinearity Junction 301 is 



n(x)=1-<-x) f (4) 

10 for various values of r. For example, others hav© found r = 1/3 to be best While ft is advantageous to choose m as 
large as possible, a value of m = 7 with a 15-th order FIR filter that roughly matched (1) for samples taken at 300 dpi 
and viewed at 30 mches was found to involve a reasonable level of complexity for many applications* Approximations 
to the resulting Impulse and frequency response are shown In FIGs. 13 and 14, respectively. In FIG. 14, the dotted 
curve shows the eye MTF of FIG. 11 lor comparison; f ft = 1/t = 157.1 cycles/degree. The asymmetry of the impulse 

19 response in FIG. 1 3 is an artifact of the filter design program. In FIG. 1 3, t is equal to 0.0064 degrees. 

Similarly. for certain of the two-dimensional least-squares halftoning techniques described below it proves advan- 
tageous to use a two-dimensional discrete-space model of the form 



to 



ss 



so 



40 



45 



SO 



where the x x /s are image samples, N u is a finite neighborhood of the site (ij). the Zjj's are the model outputs (upon 
which cognition is based), and M(.) is a sliding-window function. Such a model can easily incorporate a memoryless 
nonGnearity followed by an FIR filter. Typical models that can be use* are of the form 

z^nOCg-h^) (6) 

where n(.) Is a memoryless nonlinearity (same as In the one-dimensional case), h, j is the impulse response of an RR 
filter, and * denotes convolution. For samples taken at 300 dpi and viewed at 30 inches, the two-dimensional filter could 
be given by hjj = hjhj. where h k is the one-dimensional fitter of FIGs 13 and 14. More elaborate filters could be non- 
separable and could account for the lower sensitivity of the eye to 46 degree sinusoids mentioned above. 

Printer Models, Generally 

Tnts section will introduce a framework for printer models and some specific models for laser printers. A good 
model is one that accurately predicts the gray levels produced by a printer. While the teachings of the present Invention 
may be applied to a wide variety of printer types, it proves especially advantageous to employ Vrtte-bteck" laser printers 
having, for example, 300 dpi resolution. Typical of such printers are various ones of the family of laser printers marketed 
by the Hewlett-Packard company, or the Model LZR 1260 by Data Products. 

To a first approximation, such printers are capable of producing black spots (more commonly called dots) on a 
piece of paper, at any and all sites whose coordinates are typically given in the form (FT, jT), for i o 1 f .,., N H and j = 
1 , ... , N^, where T is the horizontal and vertical spacing between dots (typically m inches), N H is the number of printable 
lines (rows of dots). is the width of a printable line in dots, and (iT. f0 are the coordinates of the jth site from the 
left, on the ith line from the top. (These coordinates are consistent with matrix notation rather than the usual convention 
forth* plana) The reciprocal of T is generally referred to as the 'printer resolution' in dots per inch (dpi). The site with 
coordinates (iT, jT) will tn the following description be called "sfte (i.j)'. The printer is controlled by sending it an N h by 
N w binary array B = p>yj, where by = 1 indicates that a black dot is to be placed at site (i,j) and b;j = 0 indicates that 
the site is to remain white. The latter will be referred to as a ■white" dot. 

As illustrated in FIG. 1 5, black dots produced by an ^ideal 1 printer are black circles (no shading) with radius .707T 
The latter is the smallest radius such that black circles placed at all sites completely cove r the page. The area of such 
a dot is 1 . 57T 2 , Le.. 57% larger than a T x T square. Accordingly, horizontally or vertically (but not diagonally) neigh- 
boring black dots overlap, and white dots are darkened by neighboring black dots. Specifically, if a white dot has d 
horizontally or vertically neighboring (contiguous) black dots, then I4.3d% of it is blackened. 

With an actual printer the black dots are not perfectly round, they're not perfectly black, they are not the ideal size, 
and they may be somewhat misplaced Other practical considerations apply to real, rather than ideal, printers. For 
example, a white line surrounded by a pair of black lines is not as bright as when surrounded by several black lines. 
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There are many potential causes for such distortions, e.g., ink spreading, spreading of the laser beam, interaction of 
the laser and the charge applred to the drum, the movement of toner particles in reaction to charge, the heat finishing, 
reflections of light within the paper, and so on. 

It should always be kept in mind that an individual dot at a site (i ,j) may only assume one of two valuer typical ly 

s bfackor white. However, as a result of phenomena such as those mentioned above, the apparent gray level produced 
by the printer in the vicinity of site (i j) depends in a complicated way on by and neighboring bits. Thus, due to the close 
spacing of dots and the limited spalial resolution of the eye, the apparent gray level can be modeled as having a 
constant value Pjj in this vicinity. That Is, although the gray level is not actually constant, the eye responds, only to an 
average gray level over the site. It is this average gray level that p-y represents. 

io Therefore, a printer mode! takes the general form 



20 



£5 



30 



35 



SO 



55 



(7> 



** where consists of b 8 j and the bits in its neighborhood and 



Pii 

is tne apparent gray level in the vicinity of site <i.j>- For concreteness. it is helpful to visualize the mode! as producing 
a gray level at all points in a page (not just at integer sites). In this sense a continuous parameter model analogous to 
the discrete parameter model of Eq. (7) is given by 

u(s.t) - £ ZP(W M >q(s-fl\l-jT) OSsS N H T,0 * t £ N W T (8) 

where u(s»t) denotes the model gray level at a point s inches from the left and t inches down from the top of a page or 
other defined surface, and 



if |s|<T/2, |t|£T/s 
otherwise 



In tailoring a model of the above form to a given printer, a main task is to identify howthe function P specffying p-^ 
depends on the bits in the neighborhood of Ify Though a variety of phenomena can contribute to this dependence, it 
proves advantageous from an analysis and computational viewpoint to limit the dependence of p, j to one in which p^ 
« is determined by the values of the binary matrix array B = (bgl in a fixed window around the site (i,j). In an illustrative 
embodiment, a 3 X 3 window centered on site (i,j) is conveniently used, though other windows may be appropriate in 
other particular embodiments. With this typical 3x3 window^ the possible values of Pcan be listed In a table, e.g., with 
Z 9 elements. 

4* An Ink-Spreading Model 

A common distortton introduced by most printers is, as illustrated in FIG. 16, that their dots are larger than the 
minimal covering sfee, as would occur, e,g„ H "ink spreading* occurred. An illustrative "ink-spreading 1 printer model 
that accounts for this phenomenon is 



PM -tar*,, = fe a + flf - f5T ,» b £lo <"» 



where Wg denotes the window surrounding bj ^ consisting of b g and its eight neighbors, as indexed below, using coro- 
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70 



15 



aw b n hue 

b 5 



(11) 



Function f 7 is the number of horizontally and vertically neighboring dots that are black (i.e., the number of ones in the 
set {b n b 9 b_ bj) function f 2 is the number o1 diagonally neighboring dote (i.e., among {b^ b rt6> b^ b^}) that are 
black and noTadiacent to any horizontally or vertically neighboring black dot (e.g., in FIG. 1 6, for the identified site (i, 
j), b^ = 1 and ^ - b w = 0). Function f 3 is the number oi pairs of neighboring black dots in which one is a horizontal 
neighbor and the other is a vertical neighbor (e.g.. b n = b* = 1 would be one such pair). The constants a, p and y are 
the ratios of the areas of the respective shaded regions shown in FIG. 17 to T 2 . 
. In terms of the ratio p of the actual dot radius to the ideal dot radius 1/J2 we have 



■-if » 1 1 



(12) 



25 



(13) 



OS 



(14) 



The above assumes 1 £ p £ V2 ; lbl, the black dots are large enough to cover a TXT square, but not so large that 
black dots separated (horizontally or vertically) by one white dot would overiap. The parameter a, which is the largest 

40 of the three factors, represents the fraction of a horizontally or vertically neighboring site covered by a black dot. For 
convenience, this mode! will be referred to as the a ink spreading model. It should be noted that the model is not linear 
in the input bits, due to the fact that paper saturates at black intensity. For an ideal printer (no ink spreading) p = 1 , the 
minimum value, and a * ,i 43, £ = 0 and y = 0. For p =a 72, the maximum value, a = .46. p = .079 and 7 = .21 . 

For a typical printer of the class noted above p * 1 ,25. This value results inct=.S3, £ = .029 and y - 0.9S. FIG. 18 

45 illustrates how the dot pattern in FIG. 1 6 is modeled with these values. To illustrate one use of this model using a 3X3 
matrix of surrounding values to predict the effective gray scale In an area, it is useful to consider the array of binary 
values which includes, for each horizontal string, the repeating 6-bit patterns shown in the left column in "fcble 1 . For 
example, one such horizontal string would be 1000001 00000... 100000. This horizontal string is then replicated verti- 
cally, i.e.. identical ones of such strings occur from the top of the image to the bottom of the image. Table 1 illustrates 

so. some interesting statistics relating to such an array. * 



TABLE 1 



Pattern 


Frequency of 1's 


Darkness Predicted by Ink-Spreading Model Window 3 (ct=0.33) 


100000 


.17 


.2B 


100100 


.93 


.55 


101000 


.33 


.55 
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TABLE 1 (continued) 



10 



15 



SB 



Pattern 


Frequency of 1's 


Darkness Predicted by Ink-Spreading Model window 3 (ct=0.33) 


11O00O 


.33 


,44 


101010 


.5 


.83 


101100 


.5 


.72 


111 ooo 


.5 


.61 


110110 


.67 


£9 i 


101110 


.67 


.89 


111100 


.67 


.78 


111110 


.S3 


.94 


111111 


1,0 


1.0 



Since the selected patterns appearing in Table 1 are horizontally periodic, the gray level of a white dot depends 
only on the presence or absence of horizontally neighboring black dots. Specifically, the gray level of a white dot is a, 
2a or 0, depending on whether there are one, two or no horizontally neighboring black dots. One can see from the 
gray levels predicted in Table 1 that the ink-spreading model does much to explain how patterns with Die same numbers 
of ones can have different gray levels. For example, it predicts the relative gray levels among the patterns with 3 ones. 
On the other hand it does not explain why the pattern 110110 produces an image which fa darker than the pattern 
101110, or why 101010 produces an image which Is darker than 111110. 

One-Dimensional Models 

It proves convenient for some purposes to adopt a simplified one-dimensional printer model. This is equivalent to 
a model for printing one line (or column) or as a model for printing vertically (or horizontally) invariant images, Le. those 
having ail horizontal (or vertical) lines the same, as for the patterns of Table 1. With such a model, the input to the 
printer is a one-dmensfonal sequence where 



so 



Pk=P(W k ). 



(15) 



3S 



W k denotes the bits in some neighborhood of b* and POty) is some function thereof. A one-dimenstenai version of the 
ink-spreading model presented above is 



Pk - P(W k ) = 



if b k = 000 

if b k = 001 or b k 
28, if b k = 101 
1» otherwise 



100 



(16) 



50 



55 



where W k = (b^ r b^. t ) is a window surrounding b k and 5 is a parameter between 0 and 1 . As illustrated in FIG. 1 9, 
this model reflects those situations in which a black dot overlaps a fraction 8 of the neighboring sites to the left and the 
right. Again the model output is not linearly related to input bits. 

To Identify the parameter 5> It proves convenient to vfew this model as a projection of the two-dimensionaJ ink 
spreading model onto one dimension. Accordingly, 5 = a = ,33 has been found to be a good value for typical .ones of 
the class of printers noted above. Further discussion of one-dimensional models will assume 5 = a. Note that for 
horizontally (vertically) periodio patterns, the one-dimensional model predicts exactly the same gray levels as the two- 
' dimensional model wfth interleaved horizontal (vertical) all-zero lines. 

The need for one-dimensional ink-spreading models with window size larger than 3 will become apparent when 
considering that in Table 1 the 1 01 01 0 pattern appears about as dark as 11 01 1 0, even though it only has three-fourths 
as many 1 's. A close examination of printer output shows that the white line in the middle of 1101 1 appears much larger 
and brighter than the white dot in the middle of 01 01 0. Moreover, the white dot in the middle of 111 01 11 appears larger 
and brighter than that in the middle of 0110110. When requirements so dictate such effects can be better captured in 
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a printer model with window size larger than 3 (of 3X3 in two dimensions). Thus, while the particular windows and 
parameters used in the illustrative printer models given above are useful for predicting perceived gray levels with 
improved accuracy, particular models may require adaptation as dictated by more complete information about (and 
control of) the underlying physical parameters (e.g., extent of ink spreading), or by more complete understanding of 
perceptual considerations. 



10 



75 



Error Diffusion Halftoning Technique 

Error diffusion halftoning techniques have been described generally above. To facilitate a better understanding of 
Improvements achieved by the present invention, some aspects of this prior art technique will now be reviewed. 

In the error diffusion halftoning each Image pixel is compared to a threshold which depends upon "prior 0 image 
pixels, usually above and to the left. Alternatively viewed, each image pixel is compared to a fixed threshold, after a 
correction factor is applied to its original gray level to account for past errors. Let [Xjj be a two-dimensional gray-scale 
image (after possible interpolation to include the same number of dots as the desired binary image), where Xg denotes 
the pixel located at the j-th row and the j-th column. It is useful to assume that the image has been scanned, and win 
be processed left to right and top to bottom. Other ordering3 axe, of course, possible as necessary in particular cases. 
The binary image [b-J produced by error diffusion is obtained by the following set of equations 



£0 



= X 



*0 



(17) 



25 



30 



*4 



if v a >t 
otherwise 



(18) 



*y = V v ij 



(19) 



40 



46 



50 



Here vj j is the 'corrected 0 value of the grayscale image. The error eg at any "instant 1 (i,j) Is defined as the difference 
between the ■corrected" gray-scale image and the binary image. The "past" errors are low-pass filtered and subtracted 
from the current image value x y before it is threshokJed to obtain the binary value bgj, where [h^ is the impulse response 
of the low-pass filter. "Thus errors are "diffused 0 over the Image. 

A diagram of the error diffusion algorithm Is shown En FIG. 20. The threshold t represented by block 310 in FIG. 
20 is fixed at the exemplary value .5, the middle of the gray-scale range. Difference elements are shown as 320 and 
325 in FIG. 20. Typically, a page image is scanned left to right and top to bottom i.e.. starting at the top left and finishing 
at the tower right The low-pass filter h,j represented by block 315 in RG, 20 has non-symmetric half-plane support, 
the two-dimensional equivalent of causality. That is. the effect of a prior pixel (to the left or above) can be accumulated 
for, but a future pixel, not yet having occurred, does not contribute to any error signal. The filter coefficients are positive 
andtheirsum is equal to one, thereby assuring stability. Error diffusion halftoning usually requires onJy one pass through 
the data. 

Various error diffusion fitters have been suggested in the Gterature (see the Ulichney paper, supra), m the following 
examples a filter proposed by Jams. Judice and Ninke in 'A Survey of Techniques for the Display of Continuous-Tone 
Pictures on Bilevel Displays.' Como. Graphics and Image Processing . Vol. 5, pp. 13-40, 197©, will be used. The filter 
is characterized by Table 2. < 

TABLE 2 





3 
46 
1 

43 






s 

46 

h 




ss 


1 


i 


4a 
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40 
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TABLE 3 



In the one-dimensional version of error diffusion the illustrative values to be used for the filter are shown in Table a 
There fe no fundamental difference between the one- and two-dimensionaJ versions of error diffusion. 

Use of Printer Models in Halftoning 

Through the- use of printer models described above, The present invention overcomes many of the disadvantages 
of the priorart halftoning techniques, including tnoee present In error drff us ton halftoning. A block/flow diagram reflecting 
one aspect of a modified error diffusion system that compensates for ink spreading is shown in FIG. 21. Only the ink 
spreading contribution© of the 'present' and "past" pixels are used. Images printed using the system represented in 
FIG. 21. with primer models characterized by Eq. (10) or Eq. (1S) have the improved apparent gray level and, at the 
same time, have the sharpness characteristic of error diffusion. In particular, the performance of this modified error 
diffusion system in regions of rapidly changing gray level and fri the presence of printer distortions is very good. 

In regions of constant gray level, the modified error diffusion algorithm of the present invention produces at least 
as many gray levels as the prior art "Classic" technique. Jn common with prior error diffusion techniques, the model- 
based modifications minimize Iow4requency artifacts by shaping the noise, he,, moving it to the higher frequencies 
where it is not visible or moving it to a blue noise range, where it proves very pleasant to the eye. In regions of slowly 
changing gray level, error diffusion does not suffer from the false contouring; there is no need to add microdither to 
the image. 

The system of FIG. 21 differs in overall organization from that of the prior art system shown in FIG. £0 by the 
inclusion and use of the printer mode! 340. Thus, in particular, the output of the thresholding operation, I.e., the actual 
binary pattern sent to the printer (represented by the functional block 335 in FIG. 21), is no longer used to generate 
the error signal to be fed back to modify the input gray scale values before submitting them to the thresholding step. 
Rather, a modified version of the binary pattern processed in accordance with printer model 340, and reflecting the 
particular characteristics of the primer, is used as the feedback sequence. This printer model may advantageously take 
the form of Eqs. (10-14) or Eq. (7). As in the prior art. this feedback sequence from difference circuit 345 is low pass 
filtered using, e.g., Eqs. (17-19), with the coefficients of Table 2 or Table 3 above. It will be understood by those skilled 
in the art that different particular filtering coefficients may be used. It should be noted thai the use of past error values 
in fitter 350 is accomplished hi standard fashion by storing required past signaJs In memon/ forming part of the digital 
filter 350. The modified error diffusion algorithm ttiat compensates tor dot overlap is shown in FIG. 21 . The modified 
error diffusion equations are 



Vig = *Uj ~ £ huC&nJ-* (20) 



ifVij>t 

otherwise 



^ = Pii.„-v ra>n tor(m.n)«i.D (22) 
where (m,n)<(Irj) means (m,n) precedes (ij) in the scanning order and 

where W U consists of b mifJ and its neighbors, but here the neighbors b k t have been determined only for <k»I) < (ij); 
they are assumed to be zero for (k.l) & (i.D- Since only the dot-overlap contributions of the 'past* pixels can be used 
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in Eq, (20), the 'past* errors keep getting updated as more binary values are computed. 

Listing 1 is a sample computer program in the well-known C Language which, when executed on a typical general 
purpose computer, e.g., the Spark Station Model 1+ processor marketed by Sun Microsystems, will perform the 
processing shown in FIG. 21 and described above. Listing 1 assumes that the input values tor the sampled gray scale 

5 image, have been stored in the processor's memory as have the low pass filter values and other needed data and 
programs. Those skilled in the ait will adapt the procedures in Listing 1 to particular other computers and languages 
as needed. The output to the printer is. as in all cases described herein, the values for 

Particular applications for the above-described printer model-based halftoning technique, and those described 
below, will use other implementing hardware and. where appropriate, software to suit the specific requirements of the 

10 application. For example, in a modification to a printer, the required processing can be accomplished by a microproc- 
essor incorporated within the printer. Model information and the controlling software can conveniently be stored in read 
only memory unite (ROMs). 

Printer Model Based Least Squares Error Halftoning 

75 

An alternative to the modified error diffusion algorithm described above will now be presented. This alternative 
approach is based on the well-known least squares error criterion. In this alternative approach, it will be assumed that 
a printer model, a visual perception model and an image are given. The cascade of the printer and visual perception 
models will be called the perceptual printing model. The least-squares approach to model-based halftoning then finds 

so the binary array (one bit per image pixel) that causes the perceptual printing model to produce an output that is as 
close as possible (with respect to squared error) to the response of the visual perception model to the original image. 
Rather than simply assuming the eye is a low-pass filter that averages adjacent bits (as in conventional ordered dither 
and error diffusion), this method actively exploits the visual model. While previous techniques are sometimes robust 
to (tolerant of) printer distortions (such as resistance to ink spreading), the present inventive method actively exploits 

2B printer distortions to create the best possible harftoned reproduction. The result is more apparent shades of gray and 
better tracking of edges. Note that l since the eye filter is noncausal, the least-square approach is also noncausaL That 
is, the decisions at any point in the image depend on lulure* as well as *past B decisions. In error diff usion the decisions 
at any point in the image depend only on the "past". It is this noncausality of the present least-squares approach that 
helps give it the freedom one to make sharp transitions and better track edges. 

so 

One-Dlmenslonal Least-Squares Halftoning 

A one-dimensional least-squares halftoning tecttnique of the present invention is conveniently implemented using 
a method based on the Viterbi algorithm. See e.g.. A. J. Viterbi. "Error Bounds for Convolutions! Codes and an As- 

*s ymptotically Optimum Decoding Algorithm. 0 IEEE Trans. Inf. Th„ voL IT-1 3, pp. 260-269, April 1 957. and G, 0. Forney, 
Jr., The Viterbi Algorithm, 1 Froc. IEEE , vol, 61, pp. 268-27B, Mar 1973. Because of the Viterbi algorfthm, only one 
pass through the data is required for the least-squares approach. The present least-squares halftoning method using 
the Viterbi algorithm will now be described in the context of one-dimensional image x* (Xb, -> *n-i)- 

The overall system to be described is shown in FIG. 22. There, the input to the least-squares halftoning system a 

40 one dimensional image x= fr,.....^) applied on input 425 in FIG. 22. A printer model 410 shown receiving the binary 
array b k or input 435. in FIG, 22 may e.g., be of the type given above in connection with Eq. (15), and have a slic5n&- 
windowform given by 

This window will cause the printer output to be based on binary inputs extending n bits in either direction from the 
current bit. Finally, an eye model 420 including a memoryless nonlinearity n(X), shown as 430 in FIG. 22, followed by 
a finite impulse response filter 440 with impulse response h^,...^ will be used. 
30 In the least-squares approach the halftoned approximation bo,....b N ., is sought that minimizes the squared error 



C = M S(z k -w k ) 2 (25) 
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where, as illustrated in HG. 22 



Again, * indicates convolution. 
The boundary conditions are 



EP 0 500 267 Bl 

w k =y k -h k =n(p k rh k (27) 

b k = 0 for k <m + a k >N - m -n - 1 

^ = 0 for k <m, k> N - m - 1 . 

These boundary conditions guarantee that the perceived images (the response of the printer perceptual model to the 
bits and the response of the perceptual model to the original image) are perfectly white fork <0 and loN-1, and 
gradually darken to the "true' intensity in a border of m + n dots. 

In formulating the minimization so the Vfterbi algorithm may be conveniently applied, the approach of G, Ungerb- 
oecK "Adaptive Maximum-likelihood Receiver for Carrier-modulated Data-transmission Systems," IEEE Trans, Com- 
mon,, vol. COM-22. pp. 624-636, May 1 974, A. S. Acampora, ■Maximum-liKelihood Decoding of Binary Convolution^ 
Codes on Bandlimrted Satellfte Channel". National Telecommunications Conference, 1976, and in A J. Vfterbi and J. 
K. Omura, Principles of Digital Communications and Coding . McGraw-Hill, New York, 1979, pp. 272-277] is followed 
generally, as it results in fewer computations. As a first step> it be shown that 

N-l ■ 

e A £ (Zk-w k ) 2 
- k=o 



N-m-l 

- 11*11* + L 

k-m 



-2v k Z k + vgH 0 + 2v k £ l vjHfc J 

j*k-2m J 



= INI 2 + £ 7k- (29) 

k=m 



where 



k=0 



S5 
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yk - -2v k Z k + vgHo + 2v k VjH k _j, (30) 

j=rk-2ra 



k+m 



k+m 

H k ~ 2 h j-khj* 



From Eq. (29), the squared error e is the sum of O^ftk which does not depend on the bits b^....^ to be selected, 
plus theTk's, each depending on a different subset of the bits. In the Vrterbi algorithm, the minimization of c is simplified 
by introducing the notion of state, which is a set of bite from which a ifk can be determined. Since yk is a function of 
u t2m ,„,u k and since each Vj is a function of b^..,.b^ ni ^e statfi 81 tlme k ma f be teken to be 

^GWhI V ' b *J' (31) 



i.e., it consists of 2m + 2n consecutive bits neighboring b^ will be considered to be the 'present* bit and b^ n to be the 
30 'most recent" bit. The state has been defined so that >k can be determinedfrom and so that S k can be deter- 
mined from and the most recent bit b^, and so that contains as few bits as possible. In essence, the state 
summarizes all that one needs to know to determine 7k expect the present bit. It follows from Eqs. (29). (30) and 
the definition of slate that 



e = ||z|f + * £ V(S k -i,S*), (32) 



where u. (...) is a function determined by Eq. (30) and from the boundary condition S m-1 = (0,... .0). 

Since there is a one-to-one correspondence between sequences of bits bo,...^^ and sequences of states 
S^-,, one may minimize t by finding the state sequence S^,..., that minimizes Eq. (32), rather than finding 
the binary sequence that minimizes Eq. (29). It is then a straightforward matter to derive the binary sequence from the 
state sequence. 

The VHerbi algorithm is an efficient way to find the minimizing state sequence. Let S denote the set of all possible 
states (the set of all binary sequences of length 2m + 2n). For each k in the range m,m+1 .....N-m-l and for each state 
s c S the VHerbi algorithm finds a state sequence s^,..., s k . 1( s (ending at time k in state = s) for which 



tUU 2 + £ H(Sj-i,Sj) (33) 



is minimum among all state sequences ending in s at time k. Let <^(s) denote the minimizing state sequence, and let 
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e^s) denote the resulting minimum value. Then the state sequence that minimizes Eq. (32) (i.e., the desired solution) 
is (o^t (s*),s*) where s* is the state for which s^., (s*) is the smallest. 

For each k starring with tern and each s, the algorithm finds s k (s) and <y k (s) using the recursion: 

e k ($) = min {e k -i(Sk-i) + H(S k -i,s)) (34) 



10 c k (s) = (s k (SV n ),*) W 

where S^r achieves minimum in «k(s) and = (0,... } 0). 

I n regard to the complexity of the algorithm, for any state s there are precisely two states that can precede it. Thus 
the minimization in Eq. (32) involves two computations of u.(.,.). an addition and a binary comparison. If sufficient 
55 memory is available, the function u, may be precomputed and saved as a matrix. In this case, the complexity of the 
algorithm, in operations per dot, is proportional to the number of states: = Thus, complexity Increases 

exponentially with m and n. but Is independent of the size of the image. 

There are ways to reduce the number of stales (complexity), at the cost of some suboptimal/ty, i.e., an increase 
in e. The state reduction approach based on the following observations: The state at time k-l was defined in such a 
2° way that it contained all bits needed to determine v,^,..., v M . which in turn enter into the third term of Eq. (30)* namety 



25 



30 



2v k J* vjH k -j (36) 

Ordinarily, some of the last terms of H. say H^ m ....H &n , t . 1 , are so small that the corresponding terms of the sum, vjH^ 
can be dropped wfthout much effect In this case, the state at tfme k may be redefined as 



so that now there are only possible states. 

55 It will bo seen that when compared w&h the prior art techniques, e.g., those of Anastaaeiou, the present invention 

does not assume perfect printing. The addition of a printer model provides a major advance in the art. Also, the above- 
described mean square error process provides a closed form solution thai will be useful In a variety of particular ap- 
plications to those skilled in the art. It te deemed that those skilled in the art with the detailed algorithmic description 
and program example for the error diffusion embodiment will be well able to implement the above-described Vlterbi- 

40 based implementation of the mean-square-error algorithm for generating the binary array for application to a printer 
such as those In class of laser printers identified above. 

Two-Dimensional Least-Squares Halftoning 

45 An illustrative two-dimensional least-squares halftoning technique of the present invention is implemented by it- 
erative optimization techniques. 

The overall system to be described is shown in FIG. 23. There, the input to the least-squares halftoning system 
is a two-dimensional gray scale image [Xjj] applied on input 425a. Image [x^ has been interpolated so that it has the 
same number of pixelsas the binary array [bjj] which controls the printer. TTu/s, i = l,~..Nw, and j = 1 ,...,N H . where N w 

*° is the width of the printable lines In dots and N H is the^number of printable lines. A printer model 41 Oa shown receiving 
the binary array [b, $ on input 435a may, e^, be of the type given above in connection with Eq. (7). An eye model 420a 
includes a memoiylessnoniinearity n(Xjj)430a followed by a finite impulse response filter 440a with impulse response 
[h; jj„ Eye model 420b is similarly defined. 

In the two-dimensional least-squares approach the halftoned approximation fb^] is sought that minimizes the 

55 squared error 
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e - 2 E (Zm" w u) 2 (38) 

where as illustrated in FIG. 23, 
1$ and 



eo Again, * indicates convolution. 

The boundary conditions are: 



b~ = O for i< 1 , b-r^Y , i<1 . j>N H 

AS 

Xjj = 0 forkl J^.^l ,i>N H . 

These boundary conditions provide that no ink is placed outside the image borders, 

30 A Two-dimensional least squares solution to Eq. (38) may be obtained by Iterative techniques. Such techniques 
may employ an inital estimate of the binary halt-toned image [bj, which could be a simple image, ejg., all white or afl 
black, or the output of any halftoning algorithm, including the mooted error diffusion or the one-dimensional least- 
squares algorithm described above. 

In an illustrative iterative technique, given an initial estimate of [bjjj as described above, for each image site 

ss the Wnary value b^ thai minimizes the squared error is determined: 



Ejj = 2 J S ( z W-w W ) 2 . (39) 
k=i-* i=j-b 

where a and b are given integers which define an area within the image pjyj. An iteration is complete when the mini- 
45 mization is performed once at each image site. So, for example, for image srte (ij). this technique dctcrmhes which 
of the two possible binary values at the site provides the smaller error wfthin the area defined by a and b. This value 
is chosen for the site (i,j) and, for a given iteration, the process continues for all the sites in some fixed or random oitJer, 
typically a raster scan. A few fterations (typicaJly 5-10) are required for convergence. It is preferred that a = b = 0. 
In a variation of the above Iterative technique, given an initial estimate of (b-^, for every Image she <m) sorns 
so fixed or random order, usually a raster scan), the binary values b^,, ta-ij^Ufe, H-j v ... j+te minimize the squared 
error are determined: 

Ei.j= 2 Z <*W-*W> 2 < 40 > 

k-i-ii-* l"r-Ji-b 
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whore ap,^ J* are gtven integers. Again, it is preferred that a = b = 0. The amount of computation doubles with 
each increment in one Of the integers i T ^Mt- A few iterations (typically 3-5) are required for convergence. 

In some cases it may be advantageous to omit filtering the image (x^) by the eye mode* 420a, Le^ to set 2jj = x Tr 
This may effect sharper hatftoned images. 
5 It should be understood that the above-described models* window sizes, filter coefficients and other system and 

method parameters are merer/ illustrativa. Other particular printer (and eye) models may prove advantageous in par- 
ticular circumstances, as will be apparent to those skilled in the art 

While it has been assumed that the printer parameters are fixed and known in advance before any of the processing 
described above, no such limitation is essential to the present invention. That is, it is advantageous in some circurn- 
io stances to adjust the printer model to account for changes in printer parameters, e.g.. over time. In particular, it is 
possible to sense printer parameters such as dot size or shape as part of the printing process. Alternatively, such 
sensing can be accomplished, as required, separately from the actual printing process, Le. , off line. After such sensing, 
the processing can incorporate the new printer parameters in all future halftoning operations. 

16 Perceptual Coding of (mages for Halftone Display 

A further illustrative embodiment is presented in Figure 24. The embodiment provides for the coding of digitized 
gray-scale images for facsimile transmission and printing on a laser primer. An illustrative digitized image may comprise 
512x512 •pixels." each pixel is an eight-bit code specifying for a small portion of the image (i.e., 1/51 2fhX 1/51 2th of 
so the image) one of 2* (or 256) gray levels. 

A digitized image for communication by the embodiment is provided to a gray-scale encoder 500. Once encoded, 
the image is communicated through a channel 600. This channel 600 may comprise a communication network (or 
circuit) and any required transmission and reception circuitry, such as a modem; storage for the encoded image; or a 
combination of both network and storage. The communicated image is received by a gray-scale decoder 700. The 
25 gray-scale decoder 700 recovers a gray-scale image from the coded data. Digital halftoning QQO is performed on the 
recovered gray-scale image. The resulting hafftoned image is printed by a laser printer 900. 

In this illustrative embodiment, the gray-scale coder may comprise the perceptual coder presented in the Figures 
2, 4> 5, and 6. The grayscale decoder may comprise that presented in Figures 7 and 10. 

SO Halftoning of Images 

Digftal halftoning 800 is a process by which patterns of binary pixels suitable for printing are generated from a 
continuous-tone image (such as the original or recovered grayscale images discussed above). Because the eye does 
not faithfully detect high spatial frequencies, patterns of binary pixels printed on paper have the appearance of the 
35 continuous-tone image from which they were generated. 

There are several techniques which provide hatftoned images. "These include ordered, clustered dither techniques, 
error diffusion techniques, and least square error techniques. For purposes of the illustrative embodiment presented 
in Bgure 24, ordered, clustered dithering is used. (It will be understood by the ordinary artisan that any halftoning 
technique could be employed in this embodiment, including, ao.. the error diffusion or least squares model-based 
40 halftoning techniques described above.) 

Figure 25 presents an illustrative hatftoner 800 for use with the embodiment presented in Figure 24. The hafftoner 
600 comprises a data interpolator 810, a summer 81 5 for adding uniform white noise to interpolated data, andaclassical 
halftone screen 820. 

Because the desired scale of a halftcned image to be printed on paper may be larger than that of a digitized 
46 continuous-tone image received by the halftoner 800 from the gray decoder 700, an interpolator is utilized to provide 
extra data to compensate for scale differential. In a typical case, the halftoner 800 will receive a digitized continuous- 
tone image, y„ of dimensions N., XN 2 f rom the gray decoder 700. The dimensions of the dot pattern Nlj xM 3 are obtained 
from the printer resolution and the image dimensions. Given a fixed printer resolution R (dots/inch) and desired dimen- 
sions of the image to be primed, interpolation may be perfoimed to provide the additional data needed for the dimen- 
so eions of the printed Image. The dimensions of the interpolated continuous tone image, u m are M, XM^ An illustrative 
well known technique for this is bilinear interpolation, which provides the ability to expand the received continuous- 
tone image to arbitrary dimensions. 

Ordered, clustered dither halftoning, well known in the art. is provided by halftoning screen 820. The screen 820 
generates a binary image, of dimensions R^XM^ by comparing pixels of a continuous-tone image (output from 
55 summer 815) to an array of periodic thresholds (this process is sometimes called screening. An example of such an 
array is the 8x8 classical screen, one period of which is shown in Figure 26. The image intensity (blackness or gray 
level) Is assumed to vary between 0 (white) and 255 (black). This metric of intensity, 0 to 255, represents varying 
amounts of ink on paper. 
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Gray-scale images for halftoning may contain regions of constant image intensity, rapidly changing image intensity 
and slowly changing image intensity. In regions of slowly varying intensity, ordered, clustered dither halftoning tech- 
niques may produce artificial contours (/.a, undesirable step-changes in image intensity) in the resulting printed image. 
These contours rapresent 33 distinct gray levels or steps available from halftoning using classical screening. See 
s Figure 27 showing such artificial contours in decreasing image intensity. This contouring problem can be eliminated 
by the addition of pseudo-random noise, of dimensions M^Mg, to the image data, u m produced by the interpolator 
810 as shown in Figure 25. Such noise may ba uniformly distributed white noise with amplitude equal to half the step 
size of the distinct gray levels. This pseudo-random noise will be referred to as mlcro-ditharxo distinguish it from spatial 
dither. Figure 28 shows that the addition of microdither can eliminate the undesirable contours present in Figure 27. 

70 

Perceptual Analysis 

As discussed above, an illustrative coder embodiment useful in carrying out the present invention Is presented in 
Figures 2, 4. 5, and 6. The coder includes perceptual mode) 28. In order to provide the base sensitivities 102 of the 

is perceptual model 28 (see Figures 2 and 5), a perceptual analysis is conducted. The perceptual analysis may take into 
account the characteristics of the printer, the type of halftoning technique employed, and viewing conditions. 

An illustrative perceptual analysis is conducted using a 300 dots/inch write-black laser printer, such as that sold 
under the trademark "H P Laser Jet," with an 8x8 classical halftoning screen, such as that discussed above with refer- 
ence to Figure 2$. A micro-dither as described above is added to the output of the bPinear interpolator 810. 

20 in the illustrative perceptual analysis, the resolution of the original images is 512x512 pixels. The dimensions of 
the printed image are 5. 12X5. 1 2 inches. At 300 dotsfinch, the resolution of the dot patterns Is 1 536x1 536 pixels. Thus, 
N t = Na = 512 and M 1 = Ma s 1536. 

The illustrative perceptual analysis determines an amount of noise that can be added to each sub-band of an 
arbitrary image without being perceived by a viewer. Preferably, this amount of noise Is the maximum imperceptible 

£$ additive noise. Once determined, such noise may be used as the basis for tuning an encoder. For example, the noise 
may be used as a basts for determining sub-band DPCM quantization step stee. As discussed above, determining this 
level of noise is done by first determining the noise sensitivity In each sub-band given a flat mid-gray image. Next, the 
change in sensitivity with gray level is determined. 

in the iflustrative perceptual analysis, an image of 512x51 2 pixels, each having an intensity equal to 124 is used. 

so This level of pixel intensity is on a threshold of the cAassifca/matnxand thus represents a worst case regarding sensitivity 
to noise. The image Is filtered into 1 6 sub-bands and uniformly distributed white noise of a given rms level is added to 
the center 32X32 pixels of one sub-band of the gray-scale image. An image Is then reconstructed from these sub- 
bands. The reconstructed image, which exhibits a 128x123 noise square, is then hatftoned using the technique de- 
scribed above and presented in Figure 25. 

3$ The hatftoned reconstructed image with the noise square is printed on a 8.5X11 inch page along with a similar 
image without the noise square, as shown in Figure 29 (image with tho noise square on the right). A "book" of four of 
such pages for a given noise level and sub-band is presented to five observers. Each observer is asked to determine 
whether the image with the 'noise square' is at the right or left on a page. The location of the two images on each page 
is random. The observers are allowed to hold the printed images (5. 1 2x5.1 2 inches each; note that Figure 29 presents 

so smaller images containing the salient portions of the 5.12x5.12 inch images) at a comfortable distance which they 
determine, as they ordinarily would look at a picture printed on an 8.5xi i inch page. Thus, the viewing distance could 
vary from approximately 10 to 30 inches, or about 2 to © this the image height. The observers are also allowed to 
choose the fighting conditions for comfortable viewing. The energy level of the noise of the "noise square" added to 
the one sub-band is adjusted in repeated analysis until the observers can not reliably determine which image contains 

45 the "noise square". By this technique, a level of this noise. ag„ the maximum imperceptible rms notee, id ctetermined 
for the sub-band in question. This procedure is then repeated for each of the 16 sub-bands. 

The micro-dither discussed above not only removes objectionable contouring but also allows the illustrative anal- 
ysis to have meaning. As discussed above, without micro-dither, the screening procedure produces 33 regular patterns 
corresponding to the 33 gray levels. The eye is extremely sensitive toany irregularity in the pattern, even to a difference 

so of a single dot. Thus, the closer the gray level to one of the 33 levels, the lower the amplitude of noise that could be 
detected. The addmon of the micro-dither breaks the regularity of the patterns and removes this artificial sensitivity 
around the 33 gray levels. Without it, a small amount of additive noise would be noticeable and the perceptual analysis 
would yield little useful information. The addition of microdither may not be necessary if some other halftoning technique 
is used, for example, error diffusion or least squares halftoning. 

5S 

DPCM Steps tz© 

The stepsize, S, of the DPCM coders 25 is given by the following expression: 
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S(x,y,i,j) - 2VJ ■ Base(i.j) - [E T (x,y)] Wt - [b(x.v)] W \ (41) 

5 

where S (x >y ,i J) is the stepsize of the coder corresponding to the x* y th pixel and the i* j* sub-band; Base(i,D is the 
basesensitrvity of the i* sub-band; E^.y) Is the texture masking adjustment for thex*y ft pixel and W t te an ernpifical 
weighting factor equal to 0.15; and Bfcy) is a brightness adjustment with W b as an empirical weighting factor equal to 
10 i.o (sub-band sensitivities and brightness and texture adjustments are discussed below). This expression corresponds 
to the operation of the illustrative embodiment discussed with reference to Figure 5. 

Sub-Band Sensitivities 

is The results of the perceptual analysis for sub-band sensitivities are given in Figure 30. Each box contains the root 
mean square noise sensitivity threshold for one of the 16 sub-bands which comprise all combinations of the four hor- 
izontal (index i) and four vertical (index i) spatial frequency partitions. The values on the figure, Baseftj), are conserv- 
ative, since each number was chosen to be the minimum value over the observer data for each sub-band (except for 
few outlying data anomalies). 
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Brightness Adjustment 

An illustrative factor for the brightness adjustment 103 Is given by the following expression: 



B(x.y) = pfmcm + l/4[sb<x > y,0 > 0) + sb(x,y+1.0,0) 
+ sb(x+ 1 ,y,0,0) + sb(x+ I fl y + 1,0,0)]] 



where F is the illustrative function plotted in Figure 31 , mean is the mean gray level forsub-band (0,0), and sb(x,y,i,j) 
is the gray level of sub-band (i,j) at location <x,y). This illustrative function F is derived' by repeating the perceptual 
ss anar/sis for sub-band (0,0) with different background image intensity levels. The illustrative perceptual analysis indi- 
cates that for printers, the human visual system is equally sensitive to noise in all gray levels. The illustrative function 
presented in Figure 31 is a constant across all levels and represents an approximation of empirically derived data 
shown in the figure as circles. 

40 Texture Masking Adjustment 

An illustrative factor for texture masking is given by the following expression: 



E T (x,y) « £ £ K(i,j)- Variance [sb<x.y.ij>l («) 

sq where K(i,j) is a weighting factor determined empirically from the modulation tmnsferf unction of the eye. For example, 
K(i j) is specified by the following matrix: 
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In the coder presented above with reference to Figures 2. 5. and 7, the QPCM step-stee is fixed for each sub-band 
and is chosen so that the perceptual threshold is met at every point in the image. When the brightness adjustment 
factor is flat, a* is the case for printers, the step-size is determined by the area of the Image with the least amount of 
texture. Thus, the texture masking adjustment 101 discussed generally above has the most effect on a coder for use 
s with laser printers when texture is present throughout the image. 

Halftoner and Printer Characteristics 

The illustrative embodiment may be augmented to provide flexibility 1 or operation with any halftoner 800 and printer 
to 900 combination, in operating with the given halftoner 800 and printer 900 combination discussed above, the coder 
25 of the illustrative embodiment incorporates a perceptual mode? 23 which is the result of the perceptual analysis 
conducted using the combination of a classical screening halftoner800 and 300 dotsflnch printer. However, tbeanafysis 
may be repeated for any number of distinct halftoner 800 and printer 900 combinations. (For example, a perceptual 
analysis could be conducted on the combination of the primer model-based error diffusion halftoning technique dis- 
is cussed above, and a 300, 400, or 600 dots/inch printer) By so doing, one or more perceptual models 28 may be made 
available to the coder 25 thereby providing the illustrative embodiment with the flexibility to operate wfth any such 
combination. 

A plurality of perceptual models 28 may be made available to the coder 25 in any of a number of ways. For example, 
data comprising individual perceptual models may be stored locally at gray encoder 500. Data for a particular perceptual 

so model might then be selected manually (for use as perceptual model 28) by a user having knowledge of the particular 
halftoner eOOyfcrinter 900 combination in use, or selected automatically by a signal(s> received from, e.g., the halftoner 
800/printer 900 combination (or a related device). Alternatively, data for a particular perceptual model may not be stored 
locally at the gray encoder 600 but rather communicated to it by; eip:, the halftoner BOO/printer 900 combination. 
In any case, it may be advantageous to group certain halftoner 800/printer 900 combinations together if differences 

25 in their perceptual models are not significant enough to warrant separate fdentif icatlon. Moreover; there may be provided 
a default set of data representing a worst case or catch a//perceptual model for use If no combination-specific perceptual 
model data is known or available. 



30 Claim* 

1. A method of coding a first image based on one or more levels of imperceptible quantization noise, the first image 
comprising a grayscale image represented by an image signal, the image signal comprising a plurality of signal 
values, the method comprising the steps of: 

1. dcterminfrig the one or more levels of imperceptible quantization noise based on 

a. a given halftone display process, and 

b. the image signal representing the first image to be coded; and 

40 

2. encoding the first image to produce one or more encoded values corresponding to one or more of said 
signal values, without introducing in an encoded value noise which exceeds a determined revel of imperceptible 
quantization noise associated with the corresponding signal value. 

45 2. The method of claim 1 wherein the step of encoding comprises the step of filtering the first image to produce a 
plurality of sub-bands. 

3. The method of claim 1 wherein the step of encoding comprises the step of quantizing one or more of said signal 
values of the first nnage, based on a quantization stepslze, to produce the one or more encoded values, and 
so wherein the quantization stepsize is a function of said determined level of imperceptible quantization noise. 

4» The method of claim 1 wherein the step of determining the one or more levels of imperceptible quantization noise 
based on the given halftone display process comprises analyzing a set of images generated by a device for dis- 
playing halftone images. 

ss 

5. The method of claim 4 wherein the analysis of a set of images generated by a device for displayin g halftone images 
comprises a comparison of two images to determine which includes additive noise. 
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6. The method of claim 5 wherein the comparison of the two images is performed under one or more conditions 
determined by a person doing the comparison. 

7. The method of claim 6 wherein the conditions comprise viewing distance, 
a The method of claim 6 wherein the conditions comprise lighting level. 

ft The method of claim 4 wherein the analysis of a set of images generated by a device for displaying halftone images 
comprises a determination of values of one or more parameters of the levels of imperceptible quantization noise 
to and wherein the step of encoding comprises the step of determining the encoded values based on such parameters. 

10. The method of claim 9 wherein the step of encoding comprises the step of filtering the first image to produce a 
plurality of $ub~bands and wherein the parameters comprise a noise sensitivity parameter for a sur>band. 

is 11 . The method of claim 9 wherein the step of determining the one or more levels of imperceptible quantization noise 
based on the image signal representing the first image comprises determining one or more values of an image 
brightness parameter and wherein the step of determining encoded values is further based on the one or more 
image brightness parameter values. 

so 12. The method of claim 9 wherein the step of determining the one or more levels of imperceptible quantization noise 
based on the Image signal representing the first image comprises determining one or more values of a parameter 
representative of a deviation of image brightness from mi*gray image brightness and wherein the step of deter- 
mining encoded values is further based on the one or more image brightness deviation paramenter values. 

26 1 3. The method of claim 9 wherem the step ot determining the one or more levels of imperceptible quantization noise 
based on the image signal representing the first image comprises determining one or more values of an image 
texture parameter and wherein the step of determining encoded values is further based on the one or more image 
texture parameter values. 

so 14. The method of claim 1 further comprising the steps of: 

communicating the one or more encoded values; 

decoding the encoded values to produce a representation of the first image; and 
displaying a representation of the first image, 

15. The method of claim 14 wherein the step df communicating comprises the step of storing the encoded values. 

16. The method of claim 14 wherein the step of displaying a representation of the first image comprises the step of 
determining a halftone image based on the representation of the first image. 

40 

17. The method of claim 16 wherein the step of determining a halftone image comprises the step of adding micxo- 
dither to a representation of the first image. 

13. The method of claim 1 6 wherein the step of determining a halftone image comprises the step of performing classical 
45 screening on a representation of the first image. 

1 9. The method of claim 1 6 wh ©rein the decoded representation of the first image comprises signal values and wherein 
the step of determining a halftone image comprises the step of interpolating to provide additional signal values for 
a representation of the first fmage. 

so 

20. The method of claim 1 9 wherein the step of determining a halftone image further comprises the step of adding 
micro-dither to the representation of the first image after the step of interpolating. 

21 . The method of claim 20 wherein the step of determining a halftone image further comprises the step of perform ing 
55 classical screening on the representation of the first image after the step of adding micro-dither. 

22. The method of claim 1 6 wherein the halftone images is determined with a printer-model based halftone technique. 
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PatentanaprOche 

1 . Verfahren zur Codierung eines ersten Bildes auf der Grundlage einer Oder mehrerer Pegel nicM wahmehmbaren 
Quantisierungsrauechens, wobei das erste Bild ©in durch ein Bildsignal dargsstelltes Grauwertbild umfa&t, wobei 

5 . das Bildsignal eine Mehrzahl von Signalwerten umfafct, mit don folgenden Schrftten: 

1. Bsstimmen des einen bzw. der mehreren Pegel nicht wahmehmbaren Quantisrerungsrauschens auf der 
Grundlage 

iq a. eines gegebenen Fiasteranzeigeprozesses und 

b. des Bildsignals, das das enste zu codierende Bild darstellt; und 

2. Codieren des ersten Bildes zur Erzeugung eines Oder mehrerer codierter Werte, die einem Oder mehreren 
der besagten Signalwerte entsprechen, ohne dab©i in einen codierten Wert Rauschen einzuf Ohren, das einen 

is clem emsprechenden Signalwert zugeordneten bestimrnten Pegel nicht wahmehmbaren Quantisierung3rau- 

schens flberechreitet 

2. Verfahren nach Anspruch 1 , wobei der Schritt des Codierens den Schritt des Filtems des ersten Bildes umfaBt, 
urn eine Mehrzahl von Teiibandem zu erzeugen. 

20 

3. Verfahren nach Anspruch 1 . wobei der Schritt des Codierens den Schntt des Quamisierens eines Oder mehrerer 
der besagten Signalwerte des ersten Bildes auf der Grundlage einer Quantisiemngs-SchrittgroBe zur Erzeugung 
des einen bzw. der mehreren codierten Werte umfaBt, und wobei die Qijantisierungs-SchriRgroGe sine Funktion 
des besagten bestimmten Pegels nicht wahmehmbaren Quantisierungsrauschens ist 

2$ 

4> Verfahren nach Anspruch 1 , wobei der Schritt des Bestimmens des einen bzw. der mehreren Pegel nicht wahr- 
nehmbaren Quantisierungsrauschens auf der Grundlage des gegebensn ftasteranzeigeprozesses das Analysie- 
ren einer Menge von dutch ein Gerat zur Anzeige von Rasterbikjem erzeugten BiWem umfa3t. 

so s. Verfahren nach Anspruch 4, wobei die Analyse einer Menge von durch ein Gerai zur Anzeige von Raaterbildem 
erzeugten Bildern einen Vergieich zweier Older zur Bestimmung, welches additives Rauschen enthalt, umfaOt. 

a Vsrfahren nach Anspruch 5 k wobei der Vergieich der beiden Bilder unter einer oder mehreren Bedlngungen durch- 
gef Ohrt wird, die durch c5e den Vergieich durchfuhrende Person bestimmt werden. 

36 

7. Verfahren nach Anspruch 6, wobei die Bedlngungen den Betrachtungsabstand umfassen. 

8. Verfahren nach Anspruch 6, wobei die Bedlngungen die Beleuchtungsstarke umfassen. 

*o 9. Verfahren nach Anspruch 4, wobei die Analyse einer Menge von durch ein Gerat zur Anzeige von Rasterbildem 
erzeugten Bildern eine Bestimmung von Werten eines oder mehrerer Parameter der Pegel nicht wahmehmbaren 
Quantfeierungsrauschene umfaBt, und wobei dsr Schritt des Codierens den Schritt des Bestsmmens der codierten 
Werte auf der Grundlage soldier Parameter umfaBt. 

46 10. Verfahren nach Anspruch 9, wobei der Schritt des Codierens den Schritt des Filtems des ersten Bildes umfaGt. 
urn eine Mehrzahl von Teiibandem zu erzeugen, und wobei die Parameter einen Rauschempfindliehkeitsparameter 
f Or ein Teilband umfassen. 

tip Verfahren nach Anspruch 9, wobei der Schritt des Bestimmens des einen bzw. der mehreren Pegel nicht wahr- 
50 nehmbaren Quantisierungsrauschens auf der Grundlage des das erste Bild darstellenden Bildsignals das Bestim- 
men eines Oder mehrerer Werte eines Bildhelligkeitsparameters umfaGt, und wobei der Schritt des Bestimmens 
codierter Werte femerauf der Grundlage des einen bzw. der mehreren BildheHigteitsparameterwert© erfolgt. 

12. Verfahren nach Anspruch 9, wobei der Schritt des Bestimmens des einen bzw. der mehreren Pegel nicht wahr- 
66 nehmbaren Quantisierungsrauschens auf der Grundlage des das erste Bild darstellenden Bildsignals das Bestim- 

men eines Oder mehrerer Werte eines Paramstors umfaBt, der eine Abweichung der Bildhelllgkeit von mittelgrauer 
Bfldhelligkeri darstellt, una wobei der Schritt des Bestimmens codierter Werte ferner auf der Grundlage des einen 
bzw. der mehreren Bildhetligkeitsabweichungsparametsrwarteerfolgt. 



27 

PAGE 34/67 ■ RCVD AT 4/17/2006 4:56:40 PM [Eastern Daylight Time] * SVR:USPTO-EFXRF-6/37 * DN1S:2738300 * CSID:6508575487 * DURATION (mm-ss):19-58 



APR. \l 2006 1:50PM HP LEGAL 



NO. 324 P. 35 



EPO500 267 B1 

13. Verfahren nach Anspruch 9, wobei der Schritt des Bestimmens des einen bzw. der mehreren Pegel nichl wahr- 
nehmbaren Quantisierungsrauschens aul der Grundlage des das erste Bi(d darstsllenden Bildsignale das Bestim- 
men eines Oder mehrerer Werte eines BMexturpararneters umfaGt, und wobei der Schritt des Bestimmens co- 
dierter Wert© feme rauf der Grundlage des ©inen bzw. der mehreren Bildtexturparameterwerte erfolgt. 

s 

14. Verfahren nach Anspruch 1 mit den lolgenden weiteren Schritten: 

Obermitteln des einen bzw. der mehreren eodierten Werte; 

Decodieren der eodierten Werte zur Erzeugung einer DarsteNung dee ersten Bildes; und 
10 Anzeigen einer Darsteiiung des ersten Bildes. 

15. Verfahren nach Anspruch 14, wobei der Schritt dee Obenmittelns den Schritt des Speichems der eodierten Werte 
umfaBt 

1 6. Verfahren nach Anspruch 14. wobei der Schritt des Anzeigens einer Darsteiiung dee ersten Bildes den Schritt des 
Bestimmens eines Rasterbildes auf der Grundlage der Darsteiiung des ersten Bildes umfaet. 

17. Verfahren nach Anspruch 16, wobei der Schritt des Bestimmens eines Rasterbildes den Schritt des HinzufQgene 
von Mikro-Dither zu einer Darsteiiung dee ersten Bildes umfaGt 

18. Verfahren nach Anspruch 16, wobei der Schritt des Bestimmens eines Rasterbildes den Schritt dee DurchfOhrens 
einer klassischen Rasterung an einer Darsteiiung des ersten Bildes umfaBt. 

19. Verfahren nach Anspruch 15. wobei die decodierte Darsteiiung des ersten Bildes Signalwerte umfaBt, und wobei 
25 der Schritt des Bestimmens eines Rasterbildes den Schritt dee InterpoBerens zur Bere'rtstellung zusitzlicher Si- 
gnalwerte fur eine Darsteiiung des ersten Bildes umfaBL 

20. Verfahren nach Anspruch 19. wobei der Schritt des Bestimmens ernes Rasterbildes nach dern Schritt des Inter- 
polierens temer den Schritt des Hinzufugens von Mikro-Dither zu der Darsteiiung des ersten BiJdes LimfaOt. 

so 

21. Verfahren nach Anspruch 20, wobei der Schritt des Bestimmens eines Rasterbildes nach dem Schritt des Hinzu- 
rogens von Mikrc-Dither femer den Schritt des Durchf Qhrens einer klassischen Rasterung an der Darsteiiung des 
ersten Bildes umfaBt 

35 22. Verfahren nach Anspruch 16, wobei das Rastorbitd mit einem druckermodelibasiertan Rasterverfahren besiimmt 
wird. 



Revendlcations 

40 

1. Methode de codage d'une premfere image basee sur un ou piusieurs niveaux de bruit de quantification impercep- 
tible, la premiere image comprenant une Image cTechelle de gris representee par un signal damage, le signaJ 
d' image comprenant une plurality de valours de signal, ta method* comprenant (es Stapes de ; 

45 1. determination du ou de piusieurs niveaux de bruit de quantification imperceptible bas$e sur 

a. un processus donn£ d 1 affichage de trames, et 

b. le signal d'image reprSsentant la premiere image a coder ; et 

so 2. codage de la premiere image pour produire une ou piusieurs vaJeurs cotdees correspondent a une ou piu- 

sieurs desdites valours de signal, sans imroduire dans une valeur cod6e un bruit qui depasse un niveau de- 
termine de bnjrt de quantification imperceptible associe k la valour de signal correspondante. 

2. Mfithode selon la revendfcation 1. dans laquelle I'Stape de codage comprend tetape de filtrage de la premiere 
55 image pour produire une plumlrte de sous-bandes. 

3. Methods selon la revendication 1, dans laquelle I'Stape de codage comprend Itetape de quantification d'une ou 
piusieurs desdites valeurs de signal de la premiere image, basee sur une taille d'echelon de quantification, pour 
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produire la ou plusieurs valeurs codees. et dans laquelle (a taifie d'echelon de quantification est une fonction dudit 
niveau determine* du bruit de quantification imperceptible. 

4. Methode selon la revendication 1 , dans laquelle I'etape da determination du ou de plusieurs niveaux de bruit de 
s quantification imperceptible basSe sur le processus donn£ d'affichage de trames comprend ranar/se d'un ensem- 
ble damages gen£r6ee par un dispoejtjf d'affichags d'images de trames. 

5. Method© selon la revendlcation 4, dans laquelle ['analyse d'un ensemble d'images g<§n6rees pa/ un dispositif 
d'affichage d'images de trarnes comprend une comparaison de deux images pour determiner cefle qui comporte 

r<3 un bruit additif. 

6. Methode selon la revendlcation 5. dans laquelle la comparaison de deux Images est effectuee sous une ou plu- 
sieurs conditions determiners par une personne etfectuant la comparaison. 

75 7. Methode selon la revendication 6. dans laquelle lea conditions comprennent la distance de visualisation. 

a Methode selon la revendlcation 6. dans laquelle les conditions comprennent le niveau cTeclairage. 

3. Method© selon fa revendication 4, dans laquelle l'analyse d'un ensemble d'images generees par un dispositif 
20 d'affichage d'images de trarnes comprend une determination de valeurs d'un ou plusieurs parametres des niveaux 

de bruit de quamiTJcation anperceptible et dans laquelle I'etape de codage comprend I'etape de determination des 
valeurs cocoes basee sur de tets parametres. 

10. Methode eeton la revendlcation 9, dans laquelle I'etape de codage comprend I'etape de filtrage de la premiere 
2S image pour produire une pluralite de sous-ban des et dans laquelle les parametres comprennent un parametre de 

sensibility au bruit pour une sous-bande. 

11. Methode selon la revencfication 9, dans laquelle 1'etape de extermination du ou de plusieurs niveaux da bruit de 
quantification imperceptible base^e sur la sfgnal d'image rapresentant la premiere image comprend la determination 

so d'une ou plusieurs valeurs tfun parametre de luminosity d'image et dans laquelle 1'etape de determination de 
valeurs codees est en outre basee sur la ou plusieurs valeurs du parametre de luminosity d'image. 

12. Methode selon la revindication g, dans laquelle I'etape de determination du ou de plusieurs niveaux de bruit de 
quantification imperceptible basee sur le signal d'image representant la premiere image comprend la determination 

36 d'une ou plusieurs valours d'un parametre represents^ d'un ecart de la luminosity d'lmaga par rapport a une 
luminosM cfimage mi-griee et dans laquelle retape de extermination de valeurs codees est en outre basse sur la 
ou plusieurs valeurs du parametre d'ecart de luminosity d'image. 

13. Methode selon la revendication 9. dans laquelle I'etape de determination du ou de plusieurs niveaux de bruit de 
4) quantification imperceptible basee sur le signal d'image representant la premiere image comprend la determination 

d'une ou plusieurs valeurs d'un parametre de texture d'image et dans laquelle retape de determination de valeurs 
codees est en outre basee sur la ou plusieurs valeurs du parametre de texture d'image. 

14. Methode selon la revendication 1, comprenant les Stapes de : 

4S 

communication de la ou plusieurs valeurs codees ; 

decodage des valeurs codees pour produire une representation de la premiere image ; et 
affichage d'une representation de la premiere image. 

so 15. Methode selon la revendlcation 14, dans laquelle retape de communication comprend I'etape de memorisation 
des valeurs codecs. 

16. Methode selon la revendication 14, dans laquelle I'etape d'affichage d'une representation de la premiere image 
comprend I'etape de determination d'une image de trame basse sur la representation de la premiere image. 

ss 

17. Methods- selon la revendication 1 6, dans laquelle I'etape de determination d'une image de trame comprend retape 
^addition de micro-juxtapositions de points a une representation de la premiere image. 
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18. Methods sebn la revendieation 16, dans laquelle I'ftapede extermination d*une imago da trame comprend retaoe 
d'execution d'un tramage ciassique sw une representation d& la premiere Image. 

19. Methode selon la revendieation 1 6. dans laquelle la representation decode© de la premiere image comprend dee 
5 vsleurs de signal st dans laquelle Petape de determination cfune image de trame comprend Petape ^interpolation 

pour foumir des valeurs de signal supplernentalres d'une representation de la premiere image. 

20. Methode selon la revendieation 19, dans laquelle PStape de determination d'une image de trame comprend en 
outre Petape cfaddition de micro-juxtapositions de points a la representation de la premiere image apres Petape 
cPinterpolation. 

21. Methode selon la revendieation 20. dans laquelle Petape de determination d'une (mage de trame comprend en 
outre Petape d'execution d'un tramage rtassique sur la representation de la premiere image apres I'etape d'addf lion 
de micro-juxtapositions de points. 



is 
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22. Methode selon la revendieation 16, dans laquelle lee images de trame sont determinees avec une technique de 
trame basee sur un modele d'impiimante. 
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